None
**Instruments Affected**: NIRSpec
Tested on CV3 data
The library imports relevant to this notebook are aready taken care of by importing PTT.
NOTE: This notebook assumes that the pipeline version to be tested is already installed and its environment is activated.
To be able to run this notebook you need to install nptt.
If all goes well you will be able to import PTT.
# Create a temporary directory to hold notebook output, and change the working directory to that directory.
import shutil
import os
from tempfile import TemporaryDirectory
use_tempdir = True
if use_tempdir:
# Create temporary directory
data_dir = TemporaryDirectory()
# Save original directory
orig_dir = os.getcwd()
# Move to new directory
os.chdir(data_dir.name)
# For info, print out where the script is running
print("Running in {}".format(os.getcwd()))
Running in /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4
# Choose CRDS cache location
use_local_crds_cache = False
crds_cache_tempdir = False
crds_cache_notebook_dir = True
crds_cache_home = False
crds_cache_custom_dir = False
crds_cache_dir_name = ""
if use_local_crds_cache:
if crds_cache_tempdir:
os.environ['CRDS_PATH'] = os.path.join(os.getcwd(), "crds")
elif crds_cache_notebook_dir:
try:
os.environ['CRDS_PATH'] = os.path.join(orig_dir, "crds")
except Exception as e:
os.environ['CRDS_PATH'] = os.path.join(os.getcwd(), "crds")
elif crds_cache_home:
os.environ['CRDS_PATH'] = os.path.join(os.environ['HOME'], 'crds', 'cache')
elif crds_cache_custom_dir:
os.environ['CRDS_PATH'] = crds_cache_dir_name
import warnings
import psutil
from astropy.io import fits
# Only print a DeprecationWarning the first time it shows up, not every time.
with warnings.catch_warnings():
warnings.simplefilter("once", category=DeprecationWarning)
import jwst
from jwst.pipeline.calwebb_detector1 import Detector1Pipeline
from jwst.assign_wcs.assign_wcs_step import AssignWcsStep
from jwst.msaflagopen.msaflagopen_step import MSAFlagOpenStep
from jwst.extract_2d.extract_2d_step import Extract2dStep
from jwst.srctype.srctype_step import SourceTypeStep
from jwst.wavecorr.wavecorr_step import WavecorrStep
from jwst.flatfield.flat_field_step import FlatFieldStep
# The latest version of NPTT is installed in the requirements text file at:
# /jwst_validation_notebooks/environment.yml
# import NPTT
import nirspec_pipe_testing_tool as nptt
# To get data from Artifactory
from ci_watson.artifactory_helpers import get_bigdata
2021-04-23 15:23:13,622 - stpipe - WARNING - /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/photutils/detection/findstars.py:33: AstropyDeprecationWarning: _StarFinderKernel was moved to the photutils.detection._utils module. Please update your import statement.
warnings.warn(f'{name} was moved to the {deprecated[name]} module. '
# Print versions used for the pipeline and NPTT
pipeline_version = jwst.__version__
nptt_version = nptt.__version__
print("Using jwst pipeline version: ", pipeline_version)
print("Using NPTT version: ", nptt_version)
Using jwst pipeline version: 1.1.0 Using NPTT version: 1.1.14
The test is a direct comparison of the result of our implementation of the flat field step algorithm versus the pipeline's implementation, i.e.: difference = absolute( Flat_nirspec_implementation - Flat_pipeline)
We expect the absolute difference to be of the order of 1x10^-6. We set this threshold by assuming that the difference should yield computer precision 1x10^-7 numbers. We then relaxed one order of magnitude due to interpolation differences in the algorithms.
For the test to be considered PASSED, every single slit (for FS data), slitlet (for MOS data) or slice (for IFU data) in the input file has to pass. If there is any failure, the whole test will be considered as FAILED.
The code for this test for Fixed Slits (FS) can be obtained from: https://github.com/spacetelescope/nirspec_pipe_testing_tool/blob/master/nirspec_pipe_testing_tool/calwebb_spec2_pytests/auxiliary_code/flattest_fs.py. For Multi Object Spectroscopy (MOS), the code is in the same repository but is named flattest_mos.py, and for Integral Field Unit (IFU) data, the test is named flattest_ifu.py.
The input file is defined in the variable input_file (see section Testing Data Set and Variable Setup).
Step description: https://jwst-pipeline.readthedocs.io/en/latest/jwst/flatfield/main.html
Pipeline code: https://github.com/spacetelescope/jwst/tree/master/jwst/flatfield
If the test PASSED this means that all slits, slitlets, or slices individually passed the test. However, if ony one individual slit (for FS data), slitlet (for MOS data) or slice (for IFU data) test failed, the whole test will be reported as FAILED.
A short description and link to the page: https://outerspace.stsci.edu/display/JWSTCC/Vanilla+Spectral+Flat+Field+Correction
Acronymns used un this notebook:
pipeline: calibration pipeline
spec2: spectroscopic calibration pipeline level 2b
PTT: NIRSpec pipeline testing tool (https://github.com/spacetelescope/nirspec_pipe_testing_tool)
The pipeline can be run from the command line in two variants: full or per step.
Tu run the spec2 pipeline in full use the command:
$ strun jwst.pipeline.Spec2Pipeline jwtest_rate.fits
Tu only run the flat_field step, use the command:
$ strun jwst.flat_field.FlatFieldStep jwtest_extract_2d.fits
These options are also callable from a script with the testing environment active. The Python call for running the pipeline in full or by step are:
$\gt$ from jwst.pipeline.calwebb_spec2 import Spec2Pipeline
$\gt$ Spec2Pipeline.call(jwtest_rate.fits)
or
$\gt$ from jwst.flat_field.flat_field_step import FlatFieldStep
$\gt$ FlatFieldStep.call(jwtest_extract_2d.fits)
For the imaging pipeline the call would be as follows:
$\gt$ from jwst.pipeline.calwebb_image2 import Image2Pipeline
$\gt$ Image2Pipeline.call(jwtest_rate.fits)
NPTT can run the spec2 pipeline either in full or per step, as well as the imaging pipeline in full. In this notebook we will use NPTT to run the pipeline and the validation tests. To run NPTT, follow the directions in the corresponding repo page.
-> For each mode, the following variables will need to be set:
All testing data is from the CV3 campaign. We chose these files because this is our most complete data set, i.e. all modes and filter-grating combinations.
Data used was for testing:
testing_data = {
'fs_prism_clear':{
'uncal_file_nrs1': 'fs_prism_nrs1_uncal.fits',
'uncal_file_nrs2': 'fs_prism_nrs2_uncal.fits',
'sflat_nrs1': 'nirspec_FS_sflat_PRISM_OPAQUE_FLAT5_nrs1_f_01.01.fits',
'sflat_nrs2': 'nirspec_FS_sflat_PRISM_OPAQUE_FLAT5_nrs2_f_01.01.fits',
'fflat': 'nirspec_FS_fflat_CLEAR_01.01.fits',
'msa_shutter_config': None },
'fs_fullframe_g395h_f290lp':{
'uncal_file_nrs1': 'fs_fullframe_g395h_f290lp_nrs1_uncal.fits',
'uncal_file_nrs2': 'fs_fullframe_g395h_f290lp_nrs2_uncal.fits',
'sflat_nrs1': 'nirspec_FS_sflat_G395H_OPAQUE_FLAT3_nrs1_f_01.01.fits',
'sflat_nrs2': 'nirspec_FS_sflat_G395H_OPAQUE_FLAT3_nrs2_f_01.01.fits',
'fflat': 'nirspec_FS_fflat_F290LP_01.01.fits',
'msa_shutter_config': None },
# Commented out because the wavecor step crashes for this data set
#'fs_allslits_g140h_f100lp':{
# 'uncal_file_nrs1': 'fs_allslits_g140h_f100lp_nrs1_uncal.fits',
# 'uncal_file_nrs2': 'fs_allslits_g140h_f100lp_nrs2_uncal.fits',
# 'sflat_nrs1': 'nirspec_FS_sflat_G140H_OPAQUE_FLAT1_nrs1_f_01.01.fits',
# 'sflat_nrs2': 'nirspec_FS_sflat_G140H_OPAQUE_FLAT1_nrs2_f_01.01.fits',
# 'fflat': 'nirspec_FS_fflat_F100LP_01.01.fits',
# 'msa_shutter_config': None },
# Commented out because the wavecor step is not populating array for this data set
#'bots_g235h_f170lp':{
# 'uncal_file_nrs1': 'bots_g235h_f170lp_nrs1_uncal.fits',
# 'uncal_file_nrs2': 'bots_g235h_f170lp_nrs2_uncal.fits',
# 'sflat_nrs1': 'nirspec_FS_sflat_G235H_OPAQUE_FLAT2_nrs1_f_01.01.fits',
# 'sflat_nrs2': 'nirspec_FS_sflat_G235H_OPAQUE_FLAT2_nrs2_f_01.01.fits',
# 'fflat': 'nirspec_FS_fflat_F170LP_01.01.fits',
# 'msa_shutter_config': None },
'mos_prism_clear':{
'uncal_file_nrs1': 'mos_prism_nrs1_uncal.fits',
'uncal_file_nrs2': 'mos_prism_nrs2_uncal.fits',
'sflat_nrs1': 'nirspec_MOS_sflat_PRISM_OPAQUE_FLAT5_nrs1_f_01.01.fits',
'sflat_nrs2': 'nirspec_MOS_sflat_PRISM_OPAQUE_FLAT5_nrs2_f_01.01.fits',
'fflat': 'nirspec_MOS_fflat_CLEAR_01.01.fits',
'msa_shutter_config': 'V0030006000104_msa.fits' },
'mos_g140m_f100lp':{
'uncal_file_nrs1': 'mos_g140m_line1_NRS1_uncal.fits',
'uncal_file_nrs2': 'mos_g140m_line1_NRS2_uncal.fits',
'sflat_nrs1': 'nirspec_MOS_sflat_G140M_OPAQUE_FLAT1_nrs1_f_01.01.fits',
'sflat_nrs2': 'nirspec_MOS_sflat_G140M_OPAQUE_FLAT1_nrs2_f_01.01.fits',
'fflat': 'nirspec_MOS_fflat_F100LP_01.01.fits',
'msa_shutter_config': 'V8460001000101_msa.fits' },
'ifu_prism_clear':{
'uncal_file_nrs1': 'ifu_prism_nrs1_uncal.fits',
'uncal_file_nrs2': 'ifu_prism_nrs2_uncal.fits',
'sflat_nrs1': 'nirspec_IFU_sflat_PRISM_OPAQUE_FLAT5_nrs1_f_01.01.fits',
'sflat_nrs2': 'nirspec_IFU_sflat_PRISM_OPAQUE_FLAT5_nrs2_f_01.01.fits',
'fflat': 'nirspec_IFU_fflat_CLEAR_01.01.fits',
'msa_shutter_config': None },
'ifu_g395h_f290lp':{
'uncal_file_nrs1': 'ifu_g395h_f290lp_nrs1_uncal.fits',
'uncal_file_nrs2': 'ifu_g395h_f290lp_nrs2_uncal.fits',
'sflat_nrs1': 'nirspec_IFU_sflat_G395H_OPAQUE_FLAT3_nrs1_f_01.01.fits',
'sflat_nrs2': 'nirspec_IFU_sflat_G395H_OPAQUE_FLAT3_nrs2_f_01.01.fits',
'fflat': 'nirspec_IFU_fflat_F290LP_01.01.fits',
'msa_shutter_config': None }
}
# define function to pull data from Artifactory
def get_artifactory_file(data_set_dict, detector):
"""This function creates a list with all the files needed per detector to run the test.
Args:
data_set_dict: dictionary, contains inputs for a specific mode and configuration
detector: string, either nrs1 or nrs2
Returns:
data: list, contains all files needed to run test
"""
files2obtain = ['uncal_file_nrs1', 'sflat_nrs1', 'fflat', 'msa_shutter_config']
data = []
for file in files2obtain:
data_file = None
try:
if '_nrs' in file and '2' in detector:
file = file.replace('_nrs1', '_nrs2')
data_file = get_bigdata('jwst_validation_notebooks',
'validation_data',
'nirspec_data',
data_set_dict[file])
except TypeError:
data.append(None)
continue
data.append(data_file)
return data
# set the D-flat path (used for all test data)
print('Getting D-Flats from Artifactory...')
dflat_nrs1 = get_bigdata('jwst_validation_notebooks',
'validation_data',
'nirspec_data',
'nirspec_dflat_nrs1_f_01.03.fits')
dflat_nrs2 = get_bigdata('jwst_validation_notebooks',
'validation_data',
'nirspec_data',
'nirspec_dflat_nrs2_f_01.03.fits')
print('Got D-flats')
# accepted threshold difference with respect to benchmark files
threshold_diff = 9.999e-5
# set NPTT switches for this test
writefile = False
save_figs = False
show_figs = True
# Get the data
results_dict = {}
detectors = ['nrs1', 'nrs2']
print('Starting to run pipeline and test...')
for mode_config, data_set_dict in testing_data.items():
for det in detectors:
print('Testing files for detector: ', det)
data = get_artifactory_file(data_set_dict, det)
uncal_file, sflat, fflat, msa_shutter_config = data
print('Working with uncal_file: ', uncal_file)
uncal_basename = os.path.basename(uncal_file)
dflat = dflat_nrs1
if '2' in det:
dflat = dflat_nrs2
# Run the stage 1 pipeline
rate_object = Detector1Pipeline.call(uncal_file)
# Make sure the MSA shutter configuration file is set up correctly
if msa_shutter_config is not None:
msa_metadata = rate_object.meta.instrument.msa_metadata_file
if msa_metadata is None or msa_metadata == 'N/A':
rate_object.meta.instrument.msa_metadata_file = msa_shutter_config
# Run the stage 2 pipeline steps
try:
pipe_object = AssignWcsStep.call(rate_object)
skip_file = False
except:
print("No open slits fall on detector ", det)
print("Skipping test for this file. \n")
skip_file = True
if not skip_file:
# only run MSA flagging on IFU or MOS data
if 'ifu' in uncal_basename.lower() or 'mos' in uncal_basename.lower():
pipe_object = MSAFlagOpenStep.call(pipe_object)
# only run extract_2d on non IFU data
if 'ifu' not in uncal_basename.lower():
pipe_object = Extract2dStep.call(pipe_object)
pipe_object = SourceTypeStep.call(pipe_object)
pipe_object = WavecorrStep.call(pipe_object)
flat_field_object = FlatFieldStep.call(pipe_object, save_interpolated_flat=True)
# Run the validation test
%matplotlib inline
interpolated_flat = os.path.basename(uncal_file).replace('uncal', 'interpolatedflat')
if 'fs' in uncal_file.lower():
print('Running flat field test for FS...')
result, result_msg, log_msgs = nptt.calwebb_spec2_pytests.auxiliary_code.flattest_fs.flattest(
flat_field_object,
dflat_path=dflat,
sflat_path=sflat,
fflat_path=fflat,
writefile=writefile,
show_figs=show_figs,
save_figs=save_figs,
interpolated_flat=interpolated_flat,
threshold_diff=threshold_diff,
debug=False)
if 'mos' in uncal_file.lower():
print('Running flat field test for MOS...')
result, result_msg, log_msgs = nptt.calwebb_spec2_pytests.auxiliary_code.flattest_mos.flattest(
flat_field_object,
dflat_path=dflat,
sflat_path=sflat,
fflat_path=fflat,
msa_shutter_conf=msa_shutter_config,
writefile=writefile,
show_figs=show_figs,
save_figs=save_figs,
interpolated_flat=interpolated_flat,
threshold_diff=threshold_diff,
debug=False)
if 'ifu' in uncal_file.lower():
print('Running flat field test for IFU...')
result, result_msg, log_msgs = nptt.calwebb_spec2_pytests.auxiliary_code.flattest_ifu.flattest(
flat_field_object,
dflat_path=dflat,
sflat_path=sflat,
fflat_path=fflat,
writefile=writefile,
mk_all_slices_plt=False,
show_figs=show_figs,
save_figs=save_figs,
interpolated_flat=interpolated_flat,
threshold_diff=threshold_diff,
debug=False)
else:
result_msg = 'skipped'
# Did the test passed
print("Did flat_field validation test passed? ", result_msg, "\n\n")
rd = {uncal_basename: result_msg}
results_dict.update(rd)
# close all open files
psutil.Process().open_files()
closing_files = []
for fd in psutil.Process().open_files():
if data_dir.name in fd.path:
closing_files.append(fd)
for fd in closing_files:
try:
print('Closing file: ', fd, '\n\n')
open(fd.fd).close()
except:
print('File already closed: ', fd, '\n\n')
Getting D-Flats from Artifactory... Got D-flats Starting to run pipeline and test... Testing files for detector: nrs1 Working with uncal_file: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/fs_prism_nrs1_uncal.fits
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/stdatamodels/validate.py:34: ValidationWarning: While validating meta.instrument.fixed_slit the following error occurred:
'FULL' is not one of ['S200A1', 'S200A2', 'S200B1', 'S400A1', 'S1600A1', 'NONE']
Failed validating 'enum' in schema:
OrderedDict([('title', 'Name of fixed slit aperture used'),
('type', 'string'),
('enum',
['S200A1',
'S200A2',
'S200B1',
'S400A1',
'S1600A1',
'NONE']),
('fits_keyword', 'FXD_SLIT'),
('blend_table', True)])
On instance:
'FULL'
warnings.warn(errmsg, ValidationWarning)
2021-04-23 15:23:30,863 - stpipe - INFO - PARS-DETECTOR1PIPELINE parameters found: /grp/crds/cache/references/jwst/jwst_nirspec_pars-detector1pipeline_0004.asdf
2021-04-23 15:23:30,881 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2021-04-23 15:23:30,882 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2021-04-23 15:23:30,883 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2021-04-23 15:23:30,884 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2021-04-23 15:23:30,885 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2021-04-23 15:23:30,886 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2021-04-23 15:23:30,887 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2021-04-23 15:23:30,888 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2021-04-23 15:23:30,889 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2021-04-23 15:23:30,890 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2021-04-23 15:23:30,890 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2021-04-23 15:23:30,892 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2021-04-23 15:23:30,893 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2021-04-23 15:23:30,894 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2021-04-23 15:23:30,895 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2021-04-23 15:23:30,896 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2021-04-23 15:23:30,897 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
2021-04-23 15:23:30,981 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/fs_prism_nrs1_uncal.fits',).
2021-04-23 15:23:30,990 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 4.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 200.0, 'min_jump_to_flag_neighbors': 10.0}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2021-04-23 15:23:31,109 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'fs_prism_nrs1_uncal.fits' reftypes = ['dark', 'gain', 'linearity', 'mask', 'persat', 'readnoise', 'refpix', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2021-04-23 15:23:31,118 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_dark_0086.fits'.
2021-04-23 15:23:31,120 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_gain_0019.fits'.
2021-04-23 15:23:31,121 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_linearity_0018.fits'.
2021-04-23 15:23:31,123 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_mask_0010.fits'.
2021-04-23 15:23:31,125 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2021-04-23 15:23:31,125 - stpipe.Detector1Pipeline - INFO - Prefetch for READNOISE reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0018.fits'.
2021-04-23 15:23:31,127 - stpipe.Detector1Pipeline - INFO - Prefetch for REFPIX reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_refpix_0022.fits'.
2021-04-23 15:23:31,128 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is 'N/A'.
2021-04-23 15:23:31,128 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is 'N/A'.
2021-04-23 15:23:31,129 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_saturation_0020.fits'.
2021-04-23 15:23:31,130 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_superbias_0113.fits'.
2021-04-23 15:23:31,133 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2021-04-23 15:23:31,134 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2021-04-23 15:23:31,134 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2021-04-23 15:23:31,450 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(1, 4, 3200, 2048) from fs_prism_nrs1_uncal.fits>,).
2021-04-23 15:23:31,451 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:23:31,643 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES and FRMDIVSR are equal; correction not needed
2021-04-23 15:23:31,644 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2021-04-23 15:23:31,644 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2021-04-23 15:23:31,723 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(1, 4, 3200, 2048) from fs_prism_nrs1_uncal.fits>,).
2021-04-23 15:23:31,724 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:23:31,739 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_nirspec_mask_0010.fits
2021-04-23 15:23:32,153 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2021-04-23 15:23:32,258 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(1, 4, 3200, 2048) from fs_prism_nrs1_uncal.fits>,).
2021-04-23 15:23:32,260 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:23:32,275 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_nirspec_saturation_0020.fits
2021-04-23 15:23:33,045 - stpipe.Detector1Pipeline.saturation - INFO - Detected 9869 saturated pixels
2021-04-23 15:23:33,090 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2021-04-23 15:23:33,123 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2021-04-23 15:23:33,222 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(1, 4, 3200, 2048) from fs_prism_nrs1_uncal.fits>,).
2021-04-23 15:23:33,223 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:23:33,223 - stpipe.Detector1Pipeline.ipc - INFO - Step skipped.
2021-04-23 15:23:33,224 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2021-04-23 15:23:33,294 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias running with args (<RampModel(1, 4, 3200, 2048) from fs_prism_nrs1_uncal.fits>,).
2021-04-23 15:23:33,295 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:23:33,310 - stpipe.Detector1Pipeline.superbias - INFO - Using SUPERBIAS reference file /grp/crds/cache/references/jwst/jwst_nirspec_superbias_0113.fits
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/stdatamodels/validate.py:34: ValidationWarning: While validating meta.exposure.readpatt the following error occurred:
'ALLIRS2' is not one of ['ACQ1', 'ACQ2', 'BRIGHT1', 'BRIGHT2', 'DEEP2', 'DEEP8', 'FAST', 'FASTGRPAVG', 'FASTGRPAVG8', 'FASTGRPAVG16', 'FASTGRPAVG32', 'FASTGRPAVG64', 'FASTR1', 'FASTR100', 'FGS', 'FGS60', 'FGS8370', 'FGS840', 'FGSRAPID', 'FINEGUIDE', 'ID', 'MEDIUM2', 'MEDIUM8', 'NIS', 'NISRAPID', 'NRS', 'NRSIRS2', 'NRSN16R4', 'NRSN32R8', 'NRSN8R2', 'NRSRAPID', 'NRSIRS2RAPID', 'NRSRAPIDD1', 'NRSRAPIDD2', 'NRSRAPIDD6', 'NRSSLOW', 'RAPID', 'SHALLOW2', 'SHALLOW4', 'SLOW', 'SLOWR1', 'TRACK', 'ANY', 'N/A']
Failed validating 'enum' in schema:
OrderedDict([('title', 'Readout pattern'),
('type', 'string'),
('enum',
['ACQ1',
'ACQ2',
'BRIGHT1',
'BRIGHT2',
'DEEP2',
'DEEP8',
'FAST',
'FASTGRPAVG',
'FASTGRPAVG8',
'FASTGRPAVG16',
'FASTGRPAVG32',
'FASTGRPAVG64',
'FASTR1',
'FASTR100',
'FGS',
'FGS60',
'FGS8370',
'FGS840',
'FGSRAPID',
'FINEGUIDE',
'ID',
'MEDIUM2',
'MEDIUM8',
'NIS',
'NISRAPID',
'NRS',
'NRSIRS2',
'NRSN16R4',
'NRSN32R8',
'NRSN8R2',
'NRSRAPID',
'NRSIRS2RAPID',
'NRSRAPIDD1',
'NRSRAPIDD2',
'NRSRAPIDD6',
'NRSSLOW',
'RAPID',
'SHALLOW2',
'SHALLOW4',
'SLOW',
'SLOWR1',
'TRACK',
'ANY',
'N/A']),
('fits_ke ...
warnings.warn(errmsg, ValidationWarning)
2021-04-23 15:23:33,722 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias done
2021-04-23 15:23:33,820 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(1, 4, 3200, 2048) from fs_prism_nrs1_uncal.fits>,).
2021-04-23 15:23:33,821 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2021-04-23 15:23:33,836 - stpipe.Detector1Pipeline.refpix - INFO - Using refpix reference file: /grp/crds/cache/references/jwst/jwst_nirspec_refpix_0022.fits
2021-04-23 15:23:47,374 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2021-04-23 15:23:47,609 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(1, 4, 3200, 2048) from fs_prism_nrs1_uncal.fits>,).
2021-04-23 15:23:47,610 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:23:47,627 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_nirspec_linearity_0018.fits
2021-04-23 15:23:48,275 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2021-04-23 15:23:48,400 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(1, 4, 3200, 2048) from fs_prism_nrs1_uncal.fits>,).
2021-04-23 15:23:48,402 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4', 'dark_output': None}
2021-04-23 15:23:48,418 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_nirspec_dark_0086.fits
2021-04-23 15:23:52,446 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=1, ngroups=4, nframes=1, groupgap=0
2021-04-23 15:23:52,448 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=1, ngroups=65, nframes=1, groupgap=0
2021-04-23 15:23:52,917 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2021-04-23 15:23:53,617 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(1, 4, 3200, 2048) from fs_prism_nrs1_uncal.fits>,).
2021-04-23 15:23:53,618 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4', 'rejection_threshold': 4.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 200.0, 'min_jump_to_flag_neighbors': 10.0}
2021-04-23 15:23:53,626 - stpipe.Detector1Pipeline.jump - WARNING - Can not apply jump detection when NGROUPS<=4;
2021-04-23 15:23:53,627 - stpipe.Detector1Pipeline.jump - WARNING - Jump step will be skipped
2021-04-23 15:23:53,739 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2021-04-23 15:23:53,826 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(1, 4, 3200, 2048) from fs_prism_nrs1_uncal.fits>,).
2021-04-23 15:23:53,828 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}
2021-04-23 15:23:53,852 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0018.fits
2021-04-23 15:23:53,883 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0019.fits
2021-04-23 15:23:53,913 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2021-04-23 15:23:53,914 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
2021-04-23 15:24:05,605 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 4
2021-04-23 15:24:05,606 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 1
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/jwst/ramp_fitting/ramp_fit.py:1091: RuntimeWarning: divide by zero encountered in true_divide
var_p2 = 1/(s_inv_var_p3.sum(axis=0))
2021-04-23 15:24:05,717 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2021-04-23 15:24:05,833 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<ImageModel(2048, 2048) from fs_prism_nrs1_uncal.fits>,).
2021-04-23 15:24:05,835 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:24:05,880 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2021-04-23 15:24:05,880 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2021-04-23 15:24:05,881 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2021-04-23 15:24:05,963 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(1, 2048, 2048) from fs_prism_nrs1_uncal.fits>,).
2021-04-23 15:24:05,964 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:24:06,005 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2021-04-23 15:24:06,005 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2021-04-23 15:24:06,007 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2021-04-23 15:24:06,007 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2021-04-23 15:24:06,008 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2021-04-23 15:24:06,016 - stpipe.AssignWcsStep - INFO - AssignWcsStep instance created.
2021-04-23 15:24:06,129 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep running with args (<ImageModel(2048, 2048) from fs_prism_nrs1_uncal.fits>,).
2021-04-23 15:24:06,130 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2021-04-23 15:24:06,263 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.0332140289247036 deg
2021-04-23 15:24:06,263 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3367482721805573 deg
2021-04-23 15:24:06,264 - stpipe.AssignWcsStep - INFO - theta_y correction: -1.0907214098475986e-05 deg
2021-04-23 15:24:06,264 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2021-04-23 15:24:06,586 - stpipe.AssignWcsStep - INFO - Removing slit S200B1 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:24:06,588 - stpipe.AssignWcsStep - INFO - Slits projected on detector NRS1: ['S200A1', 'S200A2', 'S400A1', 'S1600A1']
2021-04-23 15:24:06,588 - stpipe.AssignWcsStep - INFO - Computing WCS for 4 open slitlets
2021-04-23 15:24:06,602 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.0332140289247036 deg
2021-04-23 15:24:06,602 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3367482721805573 deg
2021-04-23 15:24:06,603 - stpipe.AssignWcsStep - INFO - theta_y correction: -1.0907214098475986e-05 deg
2021-04-23 15:24:06,604 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2021-04-23 15:24:06,611 - stpipe.AssignWcsStep - INFO - SPORDER= 0, wrange=[6e-07, 5.3e-06]
2021-04-23 15:24:06,699 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 1
2021-04-23 15:24:06,700 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 2
2021-04-23 15:24:06,701 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 3
2021-04-23 15:24:06,701 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 4
2021-04-23 15:24:06,701 - stpipe.AssignWcsStep - INFO - There are 4 open slits in quadrant 5
2021-04-23 15:24:06,837 - stpipe.AssignWcsStep - INFO - Created a NIRSPEC nrs_fixedslit pipeline with references {'distortion': None, 'filteroffset': None, 'specwcs': None, 'regions': None, 'wavelengthrange': '/grp/crds/cache/references/jwst/jwst_nirspec_wavelengthrange_0004.asdf', 'camera': '/grp/crds/cache/references/jwst/jwst_nirspec_camera_0004.asdf', 'collimator': '/grp/crds/cache/references/jwst/jwst_nirspec_collimator_0004.asdf', 'disperser': '/grp/crds/cache/references/jwst/jwst_nirspec_disperser_0034.asdf', 'fore': '/grp/crds/cache/references/jwst/jwst_nirspec_fore_0028.asdf', 'fpa': '/grp/crds/cache/references/jwst/jwst_nirspec_fpa_0005.asdf', 'msa': '/grp/crds/cache/references/jwst/jwst_nirspec_msa_0005.asdf', 'ote': '/grp/crds/cache/references/jwst/jwst_nirspec_ote_0005.asdf', 'ifupost': None, 'ifufore': None, 'ifuslicer': None}
2021-04-23 15:24:07,002 - stpipe.AssignWcsStep - INFO - COMPLETED assign_wcs
2021-04-23 15:24:07,005 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep done
2021-04-23 15:24:07,014 - stpipe.Extract2dStep - INFO - Extract2dStep instance created.
2021-04-23 15:24:07,178 - stpipe.Extract2dStep - INFO - Step Extract2dStep running with args (<ImageModel(2048, 2048) from fs_prism_nrs1_uncal.fits>,).
2021-04-23 15:24:07,180 - stpipe.Extract2dStep - INFO - Step Extract2dStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'slit_name': None, 'extract_orders': None, 'tsgrism_extract_height': None, 'wfss_extract_half_height': 5, 'grism_objects': None, 'mmag_extract': 99.0}
2021-04-23 15:24:07,194 - stpipe.Extract2dStep - INFO - EXP_TYPE is NRS_FIXEDSLIT
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/gwcs/utils.py:72: DeprecationWarning: `np.int` is a deprecated alias for the builtin `int`. To silence this warning, use `int` by itself. Doing this will not modify any behavior and is safe. When replacing `np.int`, you may wish to use e.g. `np.int64` or `np.int32` to specify the precision. If you wish to review your current use, check the release note link for additional information.
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
indx = np.asarray(np.floor(np.asarray(value) + 0.5), dtype=np.int)
2021-04-23 15:24:07,368 - stpipe.Extract2dStep - INFO - Name of subarray extracted: S200A1
2021-04-23 15:24:07,369 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 1083 1518
2021-04-23 15:24:07,370 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1056 1096
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/gwcs/geometry.py:203: RuntimeWarning: invalid value encountered in remainder
lon = np.mod(lon, 360.0 * u.deg if nquant else 360.0)
2021-04-23 15:24:07,480 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:24:07,488 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.191685737 -45.682908511 156.190837415 -45.682092120 156.190771015 -45.682126390 156.191619323 -45.682942792
2021-04-23 15:24:07,488 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.191685737 -45.682908511 156.190837415 -45.682092120 156.190771015 -45.682126390 156.191619323 -45.682942792
2021-04-23 15:24:07,647 - stpipe.Extract2dStep - INFO - Name of subarray extracted: S200A2
2021-04-23 15:24:07,648 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 892 1328
2021-04-23 15:24:07,649 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1020 1060
2021-04-23 15:24:07,757 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:24:07,765 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.184519149 -45.685298792 156.183675453 -45.684484578 156.183609578 -45.684518640 156.184453260 -45.685332865
2021-04-23 15:24:07,765 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.184519149 -45.685298792 156.183675453 -45.684484578 156.183609578 -45.684518640 156.184453260 -45.685332865
2021-04-23 15:24:08,126 - stpipe.Extract2dStep - INFO - Name of subarray extracted: S400A1
2021-04-23 15:24:08,127 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 1025 1460
2021-04-23 15:24:08,127 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 979 1024
2021-04-23 15:24:08,236 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:24:08,244 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.187759056 -45.682331806 156.186793281 -45.681401531 156.186663358 -45.681468621 156.187629101 -45.682398919
2021-04-23 15:24:08,245 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.187759056 -45.682331806 156.186793281 -45.681401531 156.186663358 -45.681468621 156.187629101 -45.682398919
2021-04-23 15:24:08,401 - stpipe.Extract2dStep - INFO - Name of subarray extracted: S1600A1
2021-04-23 15:24:08,401 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 1056 1488
2021-04-23 15:24:08,402 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 959 982
2021-04-23 15:24:08,505 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:24:08,513 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.187720636 -45.680802803 156.187307671 -45.680405209 156.186792650 -45.680671077 156.187205560 -45.681068709
2021-04-23 15:24:08,514 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.187720636 -45.680802803 156.187307671 -45.680405209 156.186792650 -45.680671077 156.187205560 -45.681068709
2021-04-23 15:24:08,614 - stpipe.Extract2dStep - INFO - Step Extract2dStep done
2021-04-23 15:24:08,981 - stpipe.SourceTypeStep - INFO - SourceTypeStep instance created.
2021-04-23 15:24:09,195 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep running with args (<MultiSlitModel from fs_prism_nrs1_uncal.fits>,).
2021-04-23 15:24:09,197 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-04-23 15:24:09,204 - stpipe.SourceTypeStep - INFO - Input EXP_TYPE is NRS_FIXEDSLIT
2021-04-23 15:24:09,204 - stpipe.SourceTypeStep - INFO - Input SRCTYAPT = UNKNOWN
2021-04-23 15:24:09,205 - stpipe.SourceTypeStep - INFO - Input source type is unknown; setting default SRCTYPE = POINT
2021-04-23 15:24:09,206 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep done
2021-04-23 15:24:09,223 - stpipe.WavecorrStep - INFO - WavecorrStep instance created.
2021-04-23 15:24:09,401 - stpipe.WavecorrStep - INFO - Step WavecorrStep running with args (<MultiSlitModel from fs_prism_nrs1_uncal.fits>,).
2021-04-23 15:24:09,402 - stpipe.WavecorrStep - INFO - Step WavecorrStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-04-23 15:24:09,424 - stpipe.WavecorrStep - INFO - Using WAVECORR reference file /grp/crds/cache/references/jwst/jwst_nirspec_wavecorr_0001.asdf
2021-04-23 15:24:09,875 - stpipe.WavecorrStep - WARNING - Primary slit name not found in input
2021-04-23 15:24:09,876 - stpipe.WavecorrStep - WARNING - Skipping wavecorr correction
2021-04-23 15:24:09,878 - stpipe.WavecorrStep - INFO - Step WavecorrStep done
2021-04-23 15:24:09,893 - stpipe.FlatFieldStep - INFO - FlatFieldStep instance created.
2021-04-23 15:24:10,098 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep running with args (<MultiSlitModel from fs_prism_nrs1_uncal.fits>,).
2021-04-23 15:24:10,100 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': True, 'user_supplied_flat': None, 'inverse': False}
2021-04-23 15:24:12,548 - stpipe.FlatFieldStep - INFO - Working on slit S200A1
2021-04-23 15:24:16,012 - stpipe.FlatFieldStep - INFO - Working on slit S200A2
2021-04-23 15:24:19,625 - stpipe.FlatFieldStep - INFO - Working on slit S400A1
2021-04-23 15:24:23,425 - stpipe.FlatFieldStep - INFO - Working on slit S1600A1
2021-04-23 15:24:25,774 - stpipe.FlatFieldStep - INFO - Saved model in fs_prism_nrs1_interpolatedflat.fits
2021-04-23 15:24:25,775 - stpipe.FlatFieldStep - INFO - Interpolated flat written to "fs_prism_nrs1_interpolatedflat.fits".
2021-04-23 15:24:25,777 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep done
Running flat field test for FS... Filename: fs_prism_nrs1_interpolatedflat.fits No. Name Ver Type Cards Dimensions Format 0 PRIMARY 1 PrimaryHDU 280 () 1 SCI 1 ImageHDU 14 (435, 40) float32 2 DQ 1 ImageHDU 11 (435, 40) int32 (rescales to uint32) 3 ERR 1 ImageHDU 9 (435, 40) float32 4 WAVELENGTH 1 ImageHDU 9 (435, 40) float32 5 SCI 2 ImageHDU 14 (436, 40) float32 6 DQ 2 ImageHDU 11 (436, 40) int32 (rescales to uint32) 7 ERR 2 ImageHDU 9 (436, 40) float32 8 WAVELENGTH 2 ImageHDU 9 (436, 40) float32 9 SCI 3 ImageHDU 14 (435, 45) float32 10 DQ 3 ImageHDU 11 (435, 45) int32 (rescales to uint32) 11 ERR 3 ImageHDU 9 (435, 45) float32 12 WAVELENGTH 3 ImageHDU 9 (435, 45) float32 13 SCI 4 ImageHDU 14 (432, 23) float32 14 DQ 4 ImageHDU 11 (432, 23) int32 (rescales to uint32) 15 ERR 4 ImageHDU 9 (432, 23) float32 16 WAVELENGTH 4 ImageHDU 9 (432, 23) float32 17 ASDF 1 BinTableHDU 11 1R x 1C [258747B] flat_field_file --> Grating:PRISM Filter:CLEAR LAMP:LINE4 Using D-flat: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_dflat_nrs1_f_01.03.fits Using S-flat: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_FS_sflat_PRISM_OPAQUE_FLAT5_nrs1_f_01.01.fits Using F-flat: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_FS_fflat_CLEAR_01.01.fits Now looping through the slits. This may take a while... Working with slit: S200A1 exp_type = NRS_FIXEDSLIT SCI ext = 1
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/gwcs/geometry.py:203: RuntimeWarning: invalid value encountered in remainder lon = np.mod(lon, 360.0 * u.deg if nquant else 360.0)
Subwindow origin: px0=1084 py0=1057
Looping through the wavelengths...
Calculating statistics...
Absolute Flat Difference : mean = 1.490e-05 median = 1.952e-06 stdev = 1.207e-03
Maximum AbsoluteFlat Difference = 6.227e-02
Minimum AbsoluteFlat Difference = -1.979e-02
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 73%
-> 3xtheshold = 42%
-> 5xtheshold = 26%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
*** WARNING: More than 10% of pixels have a median value greater than 5xthreshold!
*** Result of the test: PASSED
No output_directory was provided. Figures will be saved in current working directory:
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/FS_flattest_NRS1_S200A1_histogram.png
Working with slit: S200A2
exp_type = NRS_FIXEDSLIT
SCI ext = 2
Subwindow origin: px0=893 py0=1021
Looping through the wavelengths...
Calculating statistics...
Absolute Flat Difference : mean = -3.300e-06 median = -2.243e-06 stdev = 1.363e-03
Maximum AbsoluteFlat Difference = 5.924e-02
Minimum AbsoluteFlat Difference = -2.108e-02
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 74%
-> 3xtheshold = 44%
-> 5xtheshold = 27%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
*** WARNING: More than 10% of pixels have a median value greater than 5xthreshold!
*** Result of the test: PASSED
No output_directory was provided. Figures will be saved in current working directory:
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/FS_flattest_NRS1_S200A2_histogram.png
Working with slit: S400A1
exp_type = NRS_FIXEDSLIT
SCI ext = 3
Subwindow origin: px0=1026 py0=980
Looping through the wavelengths...
Calculating statistics...
Absolute Flat Difference : mean = -1.962e-05 median = -6.283e-06 stdev = 1.964e-03
Maximum AbsoluteFlat Difference = 2.124e-02
Minimum AbsoluteFlat Difference = -3.407e-02
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 84%
-> 3xtheshold = 65%
-> 5xtheshold = 51%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
*** WARNING: More than 10% of pixels have a median value greater than 5xthreshold!
*** Result of the test: PASSED
No output_directory was provided. Figures will be saved in current working directory:
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/FS_flattest_NRS1_S400A1_histogram.png
Working with slit: S1600A1
exp_type = NRS_FIXEDSLIT
SCI ext = 4
Subwindow origin: px0=1057 py0=960
Looping through the wavelengths...
Calculating statistics...
Absolute Flat Difference : mean = 1.246e-04 median = 8.209e-05 stdev = 8.585e-03
Maximum AbsoluteFlat Difference = 9.924e-02
Minimum AbsoluteFlat Difference = -9.109e-02
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 97%
-> 3xtheshold = 91%
-> 5xtheshold = 86%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
*** WARNING: More than 10% of pixels have a median value greater than 5xthreshold!
*** Result of the test: PASSED
No output_directory was provided. Figures will be saved in current working directory:
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/FS_flattest_NRS1_S1600A1_histogram.png
*** Final result for flat_field test will be reported as PASSED ***
('* Script flattest_fs.py took ', '5.504049468040466 minutes to finish.')
Did flat_field validation test passed? All slits PASSED flat_field test.
Closing file: popenfile(path='/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/fs_prism_nrs1_interpolatedflat.fits', fd=43, position=999360, mode='r', flags=557056)
Closing file: popenfile(path='/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/fs_prism_nrs1_interpolatedflat.fits', fd=46, position=999360, mode='r', flags=557056)
Closing file: popenfile(path='/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_dflat_nrs1_f_01.03.fits', fd=47, position=680480640, mode='r', flags=557056)
Closing file: popenfile(path='/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_FS_sflat_PRISM_OPAQUE_FLAT5_nrs1_f_01.01.fits', fd=48, position=50791680, mode='r', flags=557056)
Closing file: popenfile(path='/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_FS_fflat_CLEAR_01.01.fits', fd=49, position=420480, mode='r', flags=557056)
Testing files for detector: nrs2
Working with uncal_file: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/fs_prism_nrs2_uncal.fits
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/stdatamodels/validate.py:34: ValidationWarning: While validating meta.instrument.fixed_slit the following error occurred:
'FULL' is not one of ['S200A1', 'S200A2', 'S200B1', 'S400A1', 'S1600A1', 'NONE']
Failed validating 'enum' in schema:
OrderedDict([('title', 'Name of fixed slit aperture used'),
('type', 'string'),
('enum',
['S200A1',
'S200A2',
'S200B1',
'S400A1',
'S1600A1',
'NONE']),
('fits_keyword', 'FXD_SLIT'),
('blend_table', True)])
On instance:
'FULL'
warnings.warn(errmsg, ValidationWarning)
2021-04-23 15:29:57,584 - stpipe - INFO - PARS-DETECTOR1PIPELINE parameters found: /grp/crds/cache/references/jwst/jwst_nirspec_pars-detector1pipeline_0004.asdf
2021-04-23 15:29:57,603 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2021-04-23 15:29:57,605 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2021-04-23 15:29:57,606 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2021-04-23 15:29:57,607 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2021-04-23 15:29:57,608 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2021-04-23 15:29:57,609 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2021-04-23 15:29:57,611 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2021-04-23 15:29:57,612 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2021-04-23 15:29:57,613 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2021-04-23 15:29:57,614 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2021-04-23 15:29:57,615 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2021-04-23 15:29:57,616 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2021-04-23 15:29:57,617 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2021-04-23 15:29:57,618 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2021-04-23 15:29:57,619 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2021-04-23 15:29:57,620 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2021-04-23 15:29:57,621 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/stpipe/step.py:359: ResourceWarning: unclosed file <_io.FileIO name='fs_prism_nrs1_interpolatedflat.fits' mode='rb' closefd=True>
gc.collect()
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/stpipe/step.py:359: ResourceWarning: unclosed file <_io.FileIO name='/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/fs_prism_nrs2_uncal.fits' mode='rb' closefd=True>
gc.collect()
2021-04-23 15:29:57,853 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/fs_prism_nrs2_uncal.fits',).
2021-04-23 15:29:57,862 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 4.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 200.0, 'min_jump_to_flag_neighbors': 10.0}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2021-04-23 15:29:57,952 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'fs_prism_nrs2_uncal.fits' reftypes = ['dark', 'gain', 'linearity', 'mask', 'persat', 'readnoise', 'refpix', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2021-04-23 15:29:57,976 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_dark_0087.fits'.
2021-04-23 15:29:57,981 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_gain_0018.fits'.
2021-04-23 15:29:57,987 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_linearity_0021.fits'.
2021-04-23 15:29:57,993 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_mask_0011.fits'.
2021-04-23 15:29:57,999 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2021-04-23 15:29:57,999 - stpipe.Detector1Pipeline - INFO - Prefetch for READNOISE reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0017.fits'.
2021-04-23 15:29:58,004 - stpipe.Detector1Pipeline - INFO - Prefetch for REFPIX reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_refpix_0020.fits'.
2021-04-23 15:29:58,010 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is 'N/A'.
2021-04-23 15:29:58,010 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is 'N/A'.
2021-04-23 15:29:58,011 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_saturation_0021.fits'.
2021-04-23 15:29:58,016 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_superbias_0114.fits'.
2021-04-23 15:29:58,022 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2021-04-23 15:29:58,022 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2021-04-23 15:29:58,023 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2021-04-23 15:29:58,517 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(1, 4, 3200, 2048) from fs_prism_nrs2_uncal.fits>,).
2021-04-23 15:29:58,519 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:29:58,700 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES and FRMDIVSR are equal; correction not needed
2021-04-23 15:29:58,701 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2021-04-23 15:29:58,702 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2021-04-23 15:29:58,921 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(1, 4, 3200, 2048) from fs_prism_nrs2_uncal.fits>,).
2021-04-23 15:29:58,923 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:29:58,941 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_nirspec_mask_0011.fits
2021-04-23 15:29:59,376 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2021-04-23 15:29:59,634 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(1, 4, 3200, 2048) from fs_prism_nrs2_uncal.fits>,).
2021-04-23 15:29:59,637 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:29:59,657 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_nirspec_saturation_0021.fits
2021-04-23 15:30:00,386 - stpipe.Detector1Pipeline.saturation - INFO - Detected 5379 saturated pixels
2021-04-23 15:30:00,411 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2021-04-23 15:30:00,436 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2021-04-23 15:30:00,700 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(1, 4, 3200, 2048) from fs_prism_nrs2_uncal.fits>,).
2021-04-23 15:30:00,702 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:30:00,703 - stpipe.Detector1Pipeline.ipc - INFO - Step skipped.
2021-04-23 15:30:00,704 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2021-04-23 15:30:00,927 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias running with args (<RampModel(1, 4, 3200, 2048) from fs_prism_nrs2_uncal.fits>,).
2021-04-23 15:30:00,929 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:30:00,950 - stpipe.Detector1Pipeline.superbias - INFO - Using SUPERBIAS reference file /grp/crds/cache/references/jwst/jwst_nirspec_superbias_0114.fits
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/stdatamodels/validate.py:34: ValidationWarning: While validating meta.exposure.readpatt the following error occurred:
'ALLIRS2' is not one of ['ACQ1', 'ACQ2', 'BRIGHT1', 'BRIGHT2', 'DEEP2', 'DEEP8', 'FAST', 'FASTGRPAVG', 'FASTGRPAVG8', 'FASTGRPAVG16', 'FASTGRPAVG32', 'FASTGRPAVG64', 'FASTR1', 'FASTR100', 'FGS', 'FGS60', 'FGS8370', 'FGS840', 'FGSRAPID', 'FINEGUIDE', 'ID', 'MEDIUM2', 'MEDIUM8', 'NIS', 'NISRAPID', 'NRS', 'NRSIRS2', 'NRSN16R4', 'NRSN32R8', 'NRSN8R2', 'NRSRAPID', 'NRSIRS2RAPID', 'NRSRAPIDD1', 'NRSRAPIDD2', 'NRSRAPIDD6', 'NRSSLOW', 'RAPID', 'SHALLOW2', 'SHALLOW4', 'SLOW', 'SLOWR1', 'TRACK', 'ANY', 'N/A']
Failed validating 'enum' in schema:
OrderedDict([('title', 'Readout pattern'),
('type', 'string'),
('enum',
['ACQ1',
'ACQ2',
'BRIGHT1',
'BRIGHT2',
'DEEP2',
'DEEP8',
'FAST',
'FASTGRPAVG',
'FASTGRPAVG8',
'FASTGRPAVG16',
'FASTGRPAVG32',
'FASTGRPAVG64',
'FASTR1',
'FASTR100',
'FGS',
'FGS60',
'FGS8370',
'FGS840',
'FGSRAPID',
'FINEGUIDE',
'ID',
'MEDIUM2',
'MEDIUM8',
'NIS',
'NISRAPID',
'NRS',
'NRSIRS2',
'NRSN16R4',
'NRSN32R8',
'NRSN8R2',
'NRSRAPID',
'NRSIRS2RAPID',
'NRSRAPIDD1',
'NRSRAPIDD2',
'NRSRAPIDD6',
'NRSSLOW',
'RAPID',
'SHALLOW2',
'SHALLOW4',
'SLOW',
'SLOWR1',
'TRACK',
'ANY',
'N/A']),
('fits_ke ...
warnings.warn(errmsg, ValidationWarning)
2021-04-23 15:30:01,393 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias done
2021-04-23 15:30:01,656 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(1, 4, 3200, 2048) from fs_prism_nrs2_uncal.fits>,).
2021-04-23 15:30:01,658 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2021-04-23 15:30:01,678 - stpipe.Detector1Pipeline.refpix - INFO - Using refpix reference file: /grp/crds/cache/references/jwst/jwst_nirspec_refpix_0020.fits
2021-04-23 15:30:15,258 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2021-04-23 15:30:15,657 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(1, 4, 3200, 2048) from fs_prism_nrs2_uncal.fits>,).
2021-04-23 15:30:15,658 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:30:15,677 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_nirspec_linearity_0021.fits
2021-04-23 15:30:16,311 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2021-04-23 15:30:16,478 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(1, 4, 3200, 2048) from fs_prism_nrs2_uncal.fits>,).
2021-04-23 15:30:16,479 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4', 'dark_output': None}
2021-04-23 15:30:16,496 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_nirspec_dark_0087.fits
2021-04-23 15:30:20,309 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=1, ngroups=4, nframes=1, groupgap=0
2021-04-23 15:30:20,310 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=1, ngroups=65, nframes=1, groupgap=0
2021-04-23 15:30:20,778 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2021-04-23 15:30:21,497 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(1, 4, 3200, 2048) from fs_prism_nrs2_uncal.fits>,).
2021-04-23 15:30:21,499 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4', 'rejection_threshold': 4.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 200.0, 'min_jump_to_flag_neighbors': 10.0}
2021-04-23 15:30:21,507 - stpipe.Detector1Pipeline.jump - WARNING - Can not apply jump detection when NGROUPS<=4;
2021-04-23 15:30:21,508 - stpipe.Detector1Pipeline.jump - WARNING - Jump step will be skipped
2021-04-23 15:30:21,621 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2021-04-23 15:30:21,750 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(1, 4, 3200, 2048) from fs_prism_nrs2_uncal.fits>,).
2021-04-23 15:30:21,751 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}
2021-04-23 15:30:21,778 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0017.fits
2021-04-23 15:30:21,808 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0018.fits
2021-04-23 15:30:21,839 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2021-04-23 15:30:21,839 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
2021-04-23 15:30:33,428 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 4
2021-04-23 15:30:33,430 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 1
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/jwst/ramp_fitting/ramp_fit.py:1091: RuntimeWarning: divide by zero encountered in true_divide
var_p2 = 1/(s_inv_var_p3.sum(axis=0))
2021-04-23 15:30:33,550 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2021-04-23 15:30:33,712 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<ImageModel(2048, 2048) from fs_prism_nrs2_uncal.fits>,).
2021-04-23 15:30:33,713 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:30:33,765 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2021-04-23 15:30:33,766 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2021-04-23 15:30:33,767 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2021-04-23 15:30:33,885 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(1, 2048, 2048) from fs_prism_nrs2_uncal.fits>,).
2021-04-23 15:30:33,886 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:30:33,932 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2021-04-23 15:30:33,933 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2021-04-23 15:30:33,934 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2021-04-23 15:30:33,935 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2021-04-23 15:30:33,935 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2021-04-23 15:30:33,944 - stpipe.AssignWcsStep - INFO - AssignWcsStep instance created.
2021-04-23 15:30:34,073 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep running with args (<ImageModel(2048, 2048) from fs_prism_nrs2_uncal.fits>,).
2021-04-23 15:30:34,074 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2021-04-23 15:30:34,246 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.0332140289247036 deg
2021-04-23 15:30:34,246 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3367482721805573 deg
2021-04-23 15:30:34,247 - stpipe.AssignWcsStep - INFO - theta_y correction: -1.0907214098475986e-05 deg
2021-04-23 15:30:34,248 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2021-04-23 15:30:34,422 - stpipe.AssignWcsStep - INFO - Removing slit S200A1 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:30:34,460 - stpipe.AssignWcsStep - INFO - Removing slit S200A2 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:30:34,504 - stpipe.AssignWcsStep - INFO - Removing slit S400A1 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:30:34,543 - stpipe.AssignWcsStep - INFO - Removing slit S1600A1 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:30:34,595 - stpipe.AssignWcsStep - INFO - Slits projected on detector NRS2: ['S200B1']
2021-04-23 15:30:34,595 - stpipe.AssignWcsStep - INFO - Computing WCS for 1 open slitlets
2021-04-23 15:30:34,608 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.0332140289247036 deg
2021-04-23 15:30:34,608 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3367482721805573 deg
2021-04-23 15:30:34,609 - stpipe.AssignWcsStep - INFO - theta_y correction: -1.0907214098475986e-05 deg
2021-04-23 15:30:34,610 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2021-04-23 15:30:34,617 - stpipe.AssignWcsStep - INFO - SPORDER= 0, wrange=[6e-07, 5.3e-06]
2021-04-23 15:30:34,710 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 1
2021-04-23 15:30:34,711 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 2
2021-04-23 15:30:34,711 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 3
2021-04-23 15:30:34,711 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 4
2021-04-23 15:30:34,712 - stpipe.AssignWcsStep - INFO - There are 1 open slits in quadrant 5
2021-04-23 15:30:34,819 - stpipe.AssignWcsStep - INFO - Created a NIRSPEC nrs_fixedslit pipeline with references {'distortion': None, 'filteroffset': None, 'specwcs': None, 'regions': None, 'wavelengthrange': '/grp/crds/cache/references/jwst/jwst_nirspec_wavelengthrange_0004.asdf', 'camera': '/grp/crds/cache/references/jwst/jwst_nirspec_camera_0004.asdf', 'collimator': '/grp/crds/cache/references/jwst/jwst_nirspec_collimator_0004.asdf', 'disperser': '/grp/crds/cache/references/jwst/jwst_nirspec_disperser_0034.asdf', 'fore': '/grp/crds/cache/references/jwst/jwst_nirspec_fore_0028.asdf', 'fpa': '/grp/crds/cache/references/jwst/jwst_nirspec_fpa_0005.asdf', 'msa': '/grp/crds/cache/references/jwst/jwst_nirspec_msa_0005.asdf', 'ote': '/grp/crds/cache/references/jwst/jwst_nirspec_ote_0005.asdf', 'ifupost': None, 'ifufore': None, 'ifuslicer': None}
2021-04-23 15:30:34,926 - stpipe.AssignWcsStep - INFO - COMPLETED assign_wcs
2021-04-23 15:30:34,929 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep done
2021-04-23 15:30:34,937 - stpipe.Extract2dStep - INFO - Extract2dStep instance created.
2021-04-23 15:30:35,071 - stpipe.Extract2dStep - INFO - Step Extract2dStep running with args (<ImageModel(2048, 2048) from fs_prism_nrs2_uncal.fits>,).
2021-04-23 15:30:35,073 - stpipe.Extract2dStep - INFO - Step Extract2dStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'slit_name': None, 'extract_orders': None, 'tsgrism_extract_height': None, 'wfss_extract_half_height': 5, 'grism_objects': None, 'mmag_extract': 99.0}
2021-04-23 15:30:35,087 - stpipe.Extract2dStep - INFO - EXP_TYPE is NRS_FIXEDSLIT
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/gwcs/utils.py:72: DeprecationWarning: `np.int` is a deprecated alias for the builtin `int`. To silence this warning, use `int` by itself. Doing this will not modify any behavior and is safe. When replacing `np.int`, you may wish to use e.g. `np.int64` or `np.int32` to specify the precision. If you wish to review your current use, check the release note link for additional information.
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
indx = np.asarray(np.floor(np.asarray(value) + 0.5), dtype=np.int)
2021-04-23 15:30:35,219 - stpipe.Extract2dStep - INFO - Name of subarray extracted: S200B1
2021-04-23 15:30:35,220 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 440 864
2021-04-23 15:30:35,220 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 918 962
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/gwcs/geometry.py:203: RuntimeWarning: invalid value encountered in remainder
lon = np.mod(lon, 360.0 * u.deg if nquant else 360.0)
2021-04-23 15:30:35,334 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:30:35,341 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.238745821 -45.653926065 156.237887188 -45.653118339 156.237822146 -45.653151380 156.238680762 -45.653959111
2021-04-23 15:30:35,342 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.238745821 -45.653926065 156.237887188 -45.653118339 156.237822146 -45.653151380 156.238680762 -45.653959111
2021-04-23 15:30:35,368 - stpipe.Extract2dStep - INFO - Step Extract2dStep done
2021-04-23 15:30:35,378 - stpipe.SourceTypeStep - INFO - SourceTypeStep instance created.
2021-04-23 15:30:35,494 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep running with args (<MultiSlitModel from fs_prism_nrs2_uncal.fits>,).
2021-04-23 15:30:35,496 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-04-23 15:30:35,502 - stpipe.SourceTypeStep - INFO - Input EXP_TYPE is NRS_FIXEDSLIT
2021-04-23 15:30:35,503 - stpipe.SourceTypeStep - INFO - Input SRCTYAPT = UNKNOWN
2021-04-23 15:30:35,503 - stpipe.SourceTypeStep - INFO - Input source type is unknown; setting default SRCTYPE = POINT
2021-04-23 15:30:35,504 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep done
2021-04-23 15:30:35,514 - stpipe.WavecorrStep - INFO - WavecorrStep instance created.
2021-04-23 15:30:35,616 - stpipe.WavecorrStep - INFO - Step WavecorrStep running with args (<MultiSlitModel from fs_prism_nrs2_uncal.fits>,).
2021-04-23 15:30:35,617 - stpipe.WavecorrStep - INFO - Step WavecorrStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-04-23 15:30:35,634 - stpipe.WavecorrStep - INFO - Using WAVECORR reference file /grp/crds/cache/references/jwst/jwst_nirspec_wavecorr_0001.asdf
2021-04-23 15:30:35,786 - stpipe.WavecorrStep - WARNING - Primary slit name not found in input
2021-04-23 15:30:35,787 - stpipe.WavecorrStep - WARNING - Skipping wavecorr correction
2021-04-23 15:30:35,788 - stpipe.WavecorrStep - INFO - Step WavecorrStep done
2021-04-23 15:30:35,799 - stpipe.FlatFieldStep - INFO - FlatFieldStep instance created.
2021-04-23 15:30:35,913 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep running with args (<MultiSlitModel from fs_prism_nrs2_uncal.fits>,).
2021-04-23 15:30:35,915 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': True, 'user_supplied_flat': None, 'inverse': False}
2021-04-23 15:30:37,816 - stpipe.FlatFieldStep - INFO - Working on slit S200B1
2021-04-23 15:30:41,391 - stpipe.FlatFieldStep - INFO - Saved model in fs_prism_nrs2_interpolatedflat.fits
2021-04-23 15:30:41,392 - stpipe.FlatFieldStep - INFO - Interpolated flat written to "fs_prism_nrs2_interpolatedflat.fits".
2021-04-23 15:30:41,394 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep done
Running flat field test for FS... Filename: fs_prism_nrs2_interpolatedflat.fits No. Name Ver Type Cards Dimensions Format 0 PRIMARY 1 PrimaryHDU 280 () 1 SCI 1 ImageHDU 14 (424, 44) float32 2 DQ 1 ImageHDU 11 (424, 44) int32 (rescales to uint32) 3 ERR 1 ImageHDU 9 (424, 44) float32 4 WAVELENGTH 1 ImageHDU 9 (424, 44) float32 5 ASDF 1 BinTableHDU 11 1R x 1C [96308B]
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/gwcs/geometry.py:203: RuntimeWarning: invalid value encountered in remainder lon = np.mod(lon, 360.0 * u.deg if nquant else 360.0)
flat_field_file --> Grating:PRISM Filter:CLEAR LAMP:LINE4
Using D-flat: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_dflat_nrs2_f_01.03.fits
Using S-flat: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_FS_sflat_PRISM_OPAQUE_FLAT5_nrs2_f_01.01.fits
* S-Flat-Field file does not have extensions for slits 200A1, 200A2, 400A, or 1600A, trying with 200B
Using F-flat: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_FS_fflat_CLEAR_01.01.fits
Now looping through the slits. This may take a while...
Working with slit: S200B1
exp_type = NRS_FIXEDSLIT
SCI ext = 1
Subwindow origin: px0=441 py0=919
Looping through the wavelengths...
Calculating statistics...
Absolute Flat Difference : mean = 1.670e-06 median = -2.495e-07 stdev = 1.192e-03
Maximum AbsoluteFlat Difference = 8.731e-02
Minimum AbsoluteFlat Difference = -1.558e-02
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 68%
-> 3xtheshold = 37%
-> 5xtheshold = 22%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
*** WARNING: More than 10% of pixels have a median value greater than 5xthreshold!
*** Result of the test: PASSED
No output_directory was provided. Figures will be saved in current working directory:
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/FS_flattest_NRS2_S200B1_histogram.png
*** Final result for flat_field test will be reported as PASSED ***
('* Script flattest_fs.py took ', '1.5097429513931275 minutes to finish.')
Did flat_field validation test passed? All slits PASSED flat_field test.
Closing file: popenfile(path='/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/fs_prism_nrs2_interpolatedflat.fits', fd=48, position=100800, mode='r', flags=557056)
Closing file: popenfile(path='/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_dflat_nrs2_f_01.03.fits', fd=49, position=680480640, mode='r', flags=557056)
Closing file: popenfile(path='/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_FS_sflat_PRISM_OPAQUE_FLAT5_nrs2_f_01.01.fits', fd=58, position=50463360, mode='r', flags=557056)
Closing file: popenfile(path='/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_FS_fflat_CLEAR_01.01.fits', fd=59, position=420480, mode='r', flags=557056)
Closing file: popenfile(path='/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/fs_prism_nrs2_interpolatedflat.fits', fd=60, position=100800, mode='r', flags=557056)
Testing files for detector: nrs1
Working with uncal_file: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/fs_fullframe_g395h_f290lp_nrs1_uncal.fits
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/stdatamodels/schema.py:188: ResourceWarning: unclosed file <_io.FileIO name='fs_prism_nrs2_interpolatedflat.fits' mode='rb' closefd=True>
cursor.update(schema)
2021-04-23 15:32:14,052 - stpipe - INFO - PARS-DETECTOR1PIPELINE parameters found: /grp/crds/cache/references/jwst/jwst_nirspec_pars-detector1pipeline_0004.asdf
2021-04-23 15:32:14,064 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2021-04-23 15:32:14,065 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2021-04-23 15:32:14,066 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2021-04-23 15:32:14,067 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2021-04-23 15:32:14,068 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2021-04-23 15:32:14,069 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2021-04-23 15:32:14,070 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2021-04-23 15:32:14,071 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2021-04-23 15:32:14,072 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2021-04-23 15:32:14,073 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2021-04-23 15:32:14,075 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2021-04-23 15:32:14,075 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2021-04-23 15:32:14,076 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2021-04-23 15:32:14,078 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2021-04-23 15:32:14,079 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2021-04-23 15:32:14,080 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2021-04-23 15:32:14,081 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
Exception ignored in: <function DataModel.__del__ at 0x7fefdc05f3a0>
Traceback (most recent call last):
File "/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/stdatamodels/model_base.py", line 337, in __del__
self.close()
File "/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/stdatamodels/model_base.py", line 359, in close
file_reference.decrement()
File "/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/stdatamodels/model_base.py", line 1112, in decrement
self._file.close()
File "/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/astropy/io/fits/hdu/hdulist.py", line 973, in close
self._file.close()
File "/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/astropy/io/fits/file.py", line 401, in close
self._file.close()
OSError: [Errno 9] Bad file descriptor
2021-04-23 15:32:14,199 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/fs_fullframe_g395h_f290lp_nrs1_uncal.fits',).
2021-04-23 15:32:14,208 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 4.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 200.0, 'min_jump_to_flag_neighbors': 10.0}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2021-04-23 15:32:14,354 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'fs_fullframe_g395h_f290lp_nrs1_uncal.fits' reftypes = ['dark', 'gain', 'linearity', 'mask', 'persat', 'readnoise', 'refpix', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2021-04-23 15:32:14,362 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_dark_0086.fits'.
2021-04-23 15:32:14,364 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_gain_0019.fits'.
2021-04-23 15:32:14,365 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_linearity_0018.fits'.
2021-04-23 15:32:14,367 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_mask_0010.fits'.
2021-04-23 15:32:14,368 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2021-04-23 15:32:14,368 - stpipe.Detector1Pipeline - INFO - Prefetch for READNOISE reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0018.fits'.
2021-04-23 15:32:14,370 - stpipe.Detector1Pipeline - INFO - Prefetch for REFPIX reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_refpix_0022.fits'.
2021-04-23 15:32:14,371 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is 'N/A'.
2021-04-23 15:32:14,372 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is 'N/A'.
2021-04-23 15:32:14,372 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_saturation_0020.fits'.
2021-04-23 15:32:14,373 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_superbias_0113.fits'.
2021-04-23 15:32:14,375 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2021-04-23 15:32:14,375 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2021-04-23 15:32:14,376 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2021-04-23 15:32:14,841 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(1, 7, 3200, 2048) from fs_fullframe_g395h_f290lp_nrs1_uncal.fits>,).
2021-04-23 15:32:14,843 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:32:15,051 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES and FRMDIVSR are equal; correction not needed
2021-04-23 15:32:15,052 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2021-04-23 15:32:15,052 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2021-04-23 15:32:15,152 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(1, 7, 3200, 2048) from fs_fullframe_g395h_f290lp_nrs1_uncal.fits>,).
2021-04-23 15:32:15,154 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:32:15,170 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_nirspec_mask_0010.fits
2021-04-23 15:32:15,633 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2021-04-23 15:32:15,755 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(1, 7, 3200, 2048) from fs_fullframe_g395h_f290lp_nrs1_uncal.fits>,).
2021-04-23 15:32:15,756 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:32:15,772 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_nirspec_saturation_0020.fits
2021-04-23 15:32:16,928 - stpipe.Detector1Pipeline.saturation - INFO - Detected 11377 saturated pixels
2021-04-23 15:32:17,004 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2021-04-23 15:32:17,036 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2021-04-23 15:32:17,178 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(1, 7, 3200, 2048) from fs_fullframe_g395h_f290lp_nrs1_uncal.fits>,).
2021-04-23 15:32:17,179 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:32:17,180 - stpipe.Detector1Pipeline.ipc - INFO - Step skipped.
2021-04-23 15:32:17,180 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2021-04-23 15:32:17,280 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias running with args (<RampModel(1, 7, 3200, 2048) from fs_fullframe_g395h_f290lp_nrs1_uncal.fits>,).
2021-04-23 15:32:17,282 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:32:17,299 - stpipe.Detector1Pipeline.superbias - INFO - Using SUPERBIAS reference file /grp/crds/cache/references/jwst/jwst_nirspec_superbias_0113.fits
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/stdatamodels/validate.py:34: ValidationWarning: While validating meta.exposure.readpatt the following error occurred:
'ALLIRS2' is not one of ['ACQ1', 'ACQ2', 'BRIGHT1', 'BRIGHT2', 'DEEP2', 'DEEP8', 'FAST', 'FASTGRPAVG', 'FASTGRPAVG8', 'FASTGRPAVG16', 'FASTGRPAVG32', 'FASTGRPAVG64', 'FASTR1', 'FASTR100', 'FGS', 'FGS60', 'FGS8370', 'FGS840', 'FGSRAPID', 'FINEGUIDE', 'ID', 'MEDIUM2', 'MEDIUM8', 'NIS', 'NISRAPID', 'NRS', 'NRSIRS2', 'NRSN16R4', 'NRSN32R8', 'NRSN8R2', 'NRSRAPID', 'NRSIRS2RAPID', 'NRSRAPIDD1', 'NRSRAPIDD2', 'NRSRAPIDD6', 'NRSSLOW', 'RAPID', 'SHALLOW2', 'SHALLOW4', 'SLOW', 'SLOWR1', 'TRACK', 'ANY', 'N/A']
Failed validating 'enum' in schema:
OrderedDict([('title', 'Readout pattern'),
('type', 'string'),
('enum',
['ACQ1',
'ACQ2',
'BRIGHT1',
'BRIGHT2',
'DEEP2',
'DEEP8',
'FAST',
'FASTGRPAVG',
'FASTGRPAVG8',
'FASTGRPAVG16',
'FASTGRPAVG32',
'FASTGRPAVG64',
'FASTR1',
'FASTR100',
'FGS',
'FGS60',
'FGS8370',
'FGS840',
'FGSRAPID',
'FINEGUIDE',
'ID',
'MEDIUM2',
'MEDIUM8',
'NIS',
'NISRAPID',
'NRS',
'NRSIRS2',
'NRSN16R4',
'NRSN32R8',
'NRSN8R2',
'NRSRAPID',
'NRSIRS2RAPID',
'NRSRAPIDD1',
'NRSRAPIDD2',
'NRSRAPIDD6',
'NRSSLOW',
'RAPID',
'SHALLOW2',
'SHALLOW4',
'SLOW',
'SLOWR1',
'TRACK',
'ANY',
'N/A']),
('fits_ke ...
warnings.warn(errmsg, ValidationWarning)
2021-04-23 15:32:17,892 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias done
2021-04-23 15:32:18,018 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(1, 7, 3200, 2048) from fs_fullframe_g395h_f290lp_nrs1_uncal.fits>,).
2021-04-23 15:32:18,019 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2021-04-23 15:32:18,035 - stpipe.Detector1Pipeline.refpix - INFO - Using refpix reference file: /grp/crds/cache/references/jwst/jwst_nirspec_refpix_0022.fits
2021-04-23 15:32:40,118 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2021-04-23 15:32:40,409 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(1, 7, 3200, 2048) from fs_fullframe_g395h_f290lp_nrs1_uncal.fits>,).
2021-04-23 15:32:40,411 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:32:40,429 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_nirspec_linearity_0018.fits
2021-04-23 15:32:41,267 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2021-04-23 15:32:41,436 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(1, 7, 3200, 2048) from fs_fullframe_g395h_f290lp_nrs1_uncal.fits>,).
2021-04-23 15:32:41,438 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4', 'dark_output': None}
2021-04-23 15:32:41,455 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_nirspec_dark_0086.fits
2021-04-23 15:32:45,374 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=1, ngroups=7, nframes=1, groupgap=0
2021-04-23 15:32:45,375 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=1, ngroups=65, nframes=1, groupgap=0
2021-04-23 15:32:45,903 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2021-04-23 15:32:46,599 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(1, 7, 3200, 2048) from fs_fullframe_g395h_f290lp_nrs1_uncal.fits>,).
2021-04-23 15:32:46,600 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4', 'rejection_threshold': 4.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 200.0, 'min_jump_to_flag_neighbors': 10.0}
2021-04-23 15:32:46,608 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 4 sigma
2021-04-23 15:32:46,619 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0019.fits
2021-04-23 15:32:46,658 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0018.fits
2021-04-23 15:32:46,690 - stpipe.Detector1Pipeline.jump - INFO - Found 32 possible cores to use for jump detection
2021-04-23 15:32:46,977 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2021-04-23 15:32:47,267 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
2021-04-23 15:32:48,743 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 88509 pixels with at least one CR
2021-04-23 15:32:51,678 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 4.69931 sec
2021-04-23 15:32:51,680 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 5.071225
2021-04-23 15:32:51,681 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2021-04-23 15:32:51,798 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(1, 7, 3200, 2048) from fs_fullframe_g395h_f290lp_nrs1_uncal.fits>,).
2021-04-23 15:32:51,800 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}
2021-04-23 15:32:51,826 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0018.fits
2021-04-23 15:32:51,858 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0019.fits
2021-04-23 15:32:51,890 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2021-04-23 15:32:51,890 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/jwst/ramp_fitting/ramp_fit.py:872: RuntimeWarning: invalid value encountered in multiply
var_p4[num_int,:,:,:] *= ( segs_4[num_int,:,:,:] > 0)
2021-04-23 15:33:23,064 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 7
2021-04-23 15:33:23,065 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 1
2021-04-23 15:33:23,202 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2021-04-23 15:33:23,331 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<ImageModel(2048, 2048) from fs_fullframe_g395h_f290lp_nrs1_uncal.fits>,).
2021-04-23 15:33:23,332 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:33:23,381 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2021-04-23 15:33:23,382 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2021-04-23 15:33:23,383 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2021-04-23 15:33:23,484 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(1, 2048, 2048) from fs_fullframe_g395h_f290lp_nrs1_uncal.fits>,).
2021-04-23 15:33:23,486 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:33:23,531 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2021-04-23 15:33:23,531 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2021-04-23 15:33:23,532 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2021-04-23 15:33:23,533 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2021-04-23 15:33:23,534 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2021-04-23 15:33:23,543 - stpipe.AssignWcsStep - INFO - AssignWcsStep instance created.
2021-04-23 15:33:23,651 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep running with args (<ImageModel(2048, 2048) from fs_fullframe_g395h_f290lp_nrs1_uncal.fits>,).
2021-04-23 15:33:23,653 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2021-04-23 15:33:23,784 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.1448970586061478 deg
2021-04-23 15:33:23,785 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3232757747173309 deg
2021-04-23 15:33:23,785 - stpipe.AssignWcsStep - INFO - theta_y correction: -3.766823889842878e-13 deg
2021-04-23 15:33:23,786 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2021-04-23 15:33:23,988 - stpipe.AssignWcsStep - INFO - Removing slit S200B1 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:33:23,989 - stpipe.AssignWcsStep - INFO - Slits projected on detector NRS1: ['S200A1', 'S200A2', 'S400A1', 'S1600A1']
2021-04-23 15:33:23,989 - stpipe.AssignWcsStep - INFO - Computing WCS for 4 open slitlets
2021-04-23 15:33:24,001 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.1448970586061478 deg
2021-04-23 15:33:24,001 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3232757747173309 deg
2021-04-23 15:33:24,002 - stpipe.AssignWcsStep - INFO - theta_y correction: -3.766823889842878e-13 deg
2021-04-23 15:33:24,002 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2021-04-23 15:33:24,009 - stpipe.AssignWcsStep - INFO - SPORDER= -1, wrange=[2.87e-06, 5.27e-06]
2021-04-23 15:33:24,100 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 1
2021-04-23 15:33:24,101 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 2
2021-04-23 15:33:24,101 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 3
2021-04-23 15:33:24,102 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 4
2021-04-23 15:33:24,102 - stpipe.AssignWcsStep - INFO - There are 4 open slits in quadrant 5
2021-04-23 15:33:24,236 - stpipe.AssignWcsStep - INFO - Created a NIRSPEC nrs_fixedslit pipeline with references {'distortion': None, 'filteroffset': None, 'specwcs': None, 'regions': None, 'wavelengthrange': '/grp/crds/cache/references/jwst/jwst_nirspec_wavelengthrange_0004.asdf', 'camera': '/grp/crds/cache/references/jwst/jwst_nirspec_camera_0004.asdf', 'collimator': '/grp/crds/cache/references/jwst/jwst_nirspec_collimator_0004.asdf', 'disperser': '/grp/crds/cache/references/jwst/jwst_nirspec_disperser_0035.asdf', 'fore': '/grp/crds/cache/references/jwst/jwst_nirspec_fore_0022.asdf', 'fpa': '/grp/crds/cache/references/jwst/jwst_nirspec_fpa_0005.asdf', 'msa': '/grp/crds/cache/references/jwst/jwst_nirspec_msa_0005.asdf', 'ote': '/grp/crds/cache/references/jwst/jwst_nirspec_ote_0005.asdf', 'ifupost': None, 'ifufore': None, 'ifuslicer': None}
2021-04-23 15:33:24,366 - stpipe.AssignWcsStep - INFO - COMPLETED assign_wcs
2021-04-23 15:33:24,369 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep done
2021-04-23 15:33:24,377 - stpipe.Extract2dStep - INFO - Extract2dStep instance created.
2021-04-23 15:33:24,498 - stpipe.Extract2dStep - INFO - Step Extract2dStep running with args (<ImageModel(2048, 2048) from fs_fullframe_g395h_f290lp_nrs1_uncal.fits>,).
2021-04-23 15:33:24,499 - stpipe.Extract2dStep - INFO - Step Extract2dStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'slit_name': None, 'extract_orders': None, 'tsgrism_extract_height': None, 'wfss_extract_half_height': 5, 'grism_objects': None, 'mmag_extract': 99.0}
2021-04-23 15:33:24,513 - stpipe.Extract2dStep - INFO - EXP_TYPE is NRS_FIXEDSLIT
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/gwcs/utils.py:72: DeprecationWarning: `np.int` is a deprecated alias for the builtin `int`. To silence this warning, use `int` by itself. Doing this will not modify any behavior and is safe. When replacing `np.int`, you may wish to use e.g. `np.int64` or `np.int32` to specify the precision. If you wish to review your current use, check the release note link for additional information.
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
indx = np.asarray(np.floor(np.asarray(value) + 0.5), dtype=np.int)
2021-04-23 15:33:24,666 - stpipe.Extract2dStep - INFO - Name of subarray extracted: S200A1
2021-04-23 15:33:24,667 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 823 2048
2021-04-23 15:33:24,667 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1060 1122
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/gwcs/geometry.py:203: RuntimeWarning: invalid value encountered in remainder
lon = np.mod(lon, 360.0 * u.deg if nquant else 360.0)
2021-04-23 15:33:24,890 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:33:24,898 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.191685737 -45.682908511 156.190837415 -45.682092120 156.190771015 -45.682126390 156.191619323 -45.682942792
2021-04-23 15:33:24,899 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.191685737 -45.682908511 156.190837415 -45.682092120 156.190771015 -45.682126390 156.191619323 -45.682942792
2021-04-23 15:33:25,038 - stpipe.Extract2dStep - INFO - Name of subarray extracted: S200A2
2021-04-23 15:33:25,039 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 633 2048
2021-04-23 15:33:25,039 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1023 1081
2021-04-23 15:33:25,188 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:33:25,196 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.184519149 -45.685298792 156.183675453 -45.684484578 156.183609578 -45.684518640 156.184453260 -45.685332865
2021-04-23 15:33:25,196 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.184519149 -45.685298792 156.183675453 -45.684484578 156.183609578 -45.684518640 156.184453260 -45.685332865
2021-04-23 15:33:25,459 - stpipe.Extract2dStep - INFO - Name of subarray extracted: S400A1
2021-04-23 15:33:25,460 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 751 2048
2021-04-23 15:33:25,460 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 983 1049
2021-04-23 15:33:25,611 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:33:25,619 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.187759056 -45.682331806 156.186793281 -45.681401531 156.186663358 -45.681468621 156.187629101 -45.682398919
2021-04-23 15:33:25,620 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.187759056 -45.682331806 156.186793281 -45.681401531 156.186663358 -45.681468621 156.187629101 -45.682398919
2021-04-23 15:33:25,760 - stpipe.Extract2dStep - INFO - Name of subarray extracted: S1600A1
2021-04-23 15:33:25,761 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 774 2048
2021-04-23 15:33:25,761 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 964 1006
2021-04-23 15:33:25,888 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:33:25,896 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.187720636 -45.680802803 156.187307671 -45.680405209 156.186792650 -45.680671077 156.187205560 -45.681068709
2021-04-23 15:33:25,896 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.187720636 -45.680802803 156.187307671 -45.680405209 156.186792650 -45.680671077 156.187205560 -45.681068709
2021-04-23 15:33:25,996 - stpipe.Extract2dStep - INFO - Step Extract2dStep done
2021-04-23 15:33:26,014 - stpipe.SourceTypeStep - INFO - SourceTypeStep instance created.
2021-04-23 15:33:26,147 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep running with args (<MultiSlitModel from fs_fullframe_g395h_f290lp_nrs1_uncal.fits>,).
2021-04-23 15:33:26,148 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-04-23 15:33:26,155 - stpipe.SourceTypeStep - INFO - Input EXP_TYPE is NRS_FIXEDSLIT
2021-04-23 15:33:26,155 - stpipe.SourceTypeStep - INFO - Input SRCTYAPT = UNKNOWN
2021-04-23 15:33:26,156 - stpipe.SourceTypeStep - INFO - Input source type is unknown; setting default SRCTYPE = POINT
2021-04-23 15:33:26,157 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep done
2021-04-23 15:33:26,171 - stpipe.WavecorrStep - INFO - WavecorrStep instance created.
2021-04-23 15:33:26,283 - stpipe.WavecorrStep - INFO - Step WavecorrStep running with args (<MultiSlitModel from fs_fullframe_g395h_f290lp_nrs1_uncal.fits>,).
2021-04-23 15:33:26,285 - stpipe.WavecorrStep - INFO - Step WavecorrStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-04-23 15:33:26,306 - stpipe.WavecorrStep - INFO - Using WAVECORR reference file /grp/crds/cache/references/jwst/jwst_nirspec_wavecorr_0001.asdf
2021-04-23 15:33:26,763 - stpipe.WavecorrStep - INFO - Detected a POINT source type in slit S200A1
2021-04-23 15:33:26,765 - stpipe.AssignWcsStep - INFO - AssignWcsStep instance created.
2021-04-23 15:33:26,958 - stpipe.WavecorrStep - INFO - Using wavelength zero-point correction for aperture S200A1
2021-04-23 15:33:26,966 - stpipe.WavecorrStep - INFO - Step WavecorrStep done
2021-04-23 15:33:26,982 - stpipe.FlatFieldStep - INFO - FlatFieldStep instance created.
2021-04-23 15:33:27,120 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep running with args (<MultiSlitModel from fs_fullframe_g395h_f290lp_nrs1_uncal.fits>,).
2021-04-23 15:33:27,122 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': True, 'user_supplied_flat': None, 'inverse': False}
2021-04-23 15:33:29,266 - stpipe.FlatFieldStep - INFO - Working on slit S200A1
2021-04-23 15:33:29,268 - stpipe.FlatFieldStep - INFO - Creating wavelength array from WCS for slit S200A1
2021-04-23 15:33:48,289 - stpipe.FlatFieldStep - INFO - Working on slit S200A2
2021-04-23 15:33:59,279 - stpipe.FlatFieldStep - INFO - Working on slit S400A1
2021-04-23 15:34:11,208 - stpipe.FlatFieldStep - INFO - Working on slit S1600A1
2021-04-23 15:34:16,873 - stpipe.FlatFieldStep - INFO - Saved model in fs_fullframe_g395h_f290lp_nrs1_interpolatedflat.fits
2021-04-23 15:34:16,873 - stpipe.FlatFieldStep - INFO - Interpolated flat written to "fs_fullframe_g395h_f290lp_nrs1_interpolatedflat.fits".
2021-04-23 15:34:16,875 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep done
Running flat field test for FS... Filename: fs_fullframe_g395h_f290lp_nrs1_interpolatedflat.fits No. Name Ver Type Cards Dimensions Format 0 PRIMARY 1 PrimaryHDU 281 () 1 SCI 1 ImageHDU 14 (1225, 62) float32 2 DQ 1 ImageHDU 11 (1225, 62) int32 (rescales to uint32) 3 ERR 1 ImageHDU 9 (1225, 62) float32 4 WAVELENGTH 1 ImageHDU 9 (1225, 62) float32 5 SCI 2 ImageHDU 14 (1415, 58) float32 6 DQ 2 ImageHDU 11 (1415, 58) int32 (rescales to uint32) 7 ERR 2 ImageHDU 9 (1415, 58) float32 8 WAVELENGTH 2 ImageHDU 9 (1415, 58) float32 9 SCI 3 ImageHDU 14 (1297, 66) float32 10 DQ 3 ImageHDU 11 (1297, 66) int32 (rescales to uint32) 11 ERR 3 ImageHDU 9 (1297, 66) float32 12 WAVELENGTH 3 ImageHDU 9 (1297, 66) float32 13 SCI 4 ImageHDU 14 (1274, 42) float32 14 DQ 4 ImageHDU 11 (1274, 42) int32 (rescales to uint32) 15 ERR 4 ImageHDU 9 (1274, 42) float32 16 WAVELENGTH 4 ImageHDU 9 (1274, 42) float32 17 ASDF 1 BinTableHDU 11 1R x 1C [240173B]
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/gwcs/geometry.py:203: RuntimeWarning: invalid value encountered in remainder lon = np.mod(lon, 360.0 * u.deg if nquant else 360.0)
flat_field_file --> Grating:G395H Filter:F290LP LAMP:LINE3
Using D-flat: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_dflat_nrs1_f_01.03.fits
Using S-flat: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_FS_sflat_G395H_OPAQUE_FLAT3_nrs1_f_01.01.fits
Using F-flat: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_FS_fflat_F290LP_01.01.fits
Now looping through the slits. This may take a while...
Working with slit: S200A1
exp_type = NRS_FIXEDSLIT
SCI ext = 1
Subwindow origin: px0=824 py0=1061
Looping through the wavelengths...
Calculating statistics...
Absolute Flat Difference : mean = -2.103e-07 median = 3.119e-07 stdev = 3.852e-04
Maximum AbsoluteFlat Difference = 5.274e-03
Minimum AbsoluteFlat Difference = -4.921e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 65%
-> 3xtheshold = 33%
-> 5xtheshold = 16%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
*** WARNING: More than 10% of pixels have a median value greater than 5xthreshold!
*** Result of the test: PASSED
No output_directory was provided. Figures will be saved in current working directory:
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/FS_flattest_NRS1_S200A1_histogram.png
Working with slit: S200A2
exp_type = NRS_FIXEDSLIT
SCI ext = 2
Subwindow origin: px0=634 py0=1024
Looping through the wavelengths...
Calculating statistics...
Absolute Flat Difference : mean = 1.875e-07 median = -3.308e-07 stdev = 3.867e-04
Maximum AbsoluteFlat Difference = 2.880e-03
Minimum AbsoluteFlat Difference = -3.248e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 66%
-> 3xtheshold = 34%
-> 5xtheshold = 17%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
*** WARNING: More than 10% of pixels have a median value greater than 5xthreshold!
*** Result of the test: PASSED
No output_directory was provided. Figures will be saved in current working directory:
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/FS_flattest_NRS1_S200A2_histogram.png
Working with slit: S400A1
exp_type = NRS_FIXEDSLIT
SCI ext = 3
Subwindow origin: px0=752 py0=984
Looping through the wavelengths...
Calculating statistics...
Absolute Flat Difference : mean = 1.170e-07 median = 2.408e-08 stdev = 7.861e-04
Maximum AbsoluteFlat Difference = 1.080e-02
Minimum AbsoluteFlat Difference = -5.366e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 79%
-> 3xtheshold = 56%
-> 5xtheshold = 40%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
*** WARNING: More than 10% of pixels have a median value greater than 5xthreshold!
*** Result of the test: PASSED
No output_directory was provided. Figures will be saved in current working directory:
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/FS_flattest_NRS1_S400A1_histogram.png
Working with slit: S1600A1
exp_type = NRS_FIXEDSLIT
SCI ext = 4
Subwindow origin: px0=775 py0=965
Looping through the wavelengths...
Calculating statistics...
Absolute Flat Difference : mean = 3.006e-05 median = 2.431e-07 stdev = 5.980e-03
Maximum AbsoluteFlat Difference = 3.195e-02
Minimum AbsoluteFlat Difference = -3.510e-02
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 97%
-> 3xtheshold = 92%
-> 5xtheshold = 88%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
*** WARNING: More than 10% of pixels have a median value greater than 5xthreshold!
*** Result of the test: PASSED
No output_directory was provided. Figures will be saved in current working directory:
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/FS_flattest_NRS1_S1600A1_histogram.png
*** Final result for flat_field test will be reported as PASSED ***
('* Script flattest_fs.py took ', '3.34633385737737 minutes to finish.')
Did flat_field validation test passed? All slits PASSED flat_field test.
Closing file: popenfile(path='/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/fs_fullframe_g395h_f290lp_nrs1_interpolatedflat.fits', fd=48, position=4181760, mode='r', flags=557056)
Closing file: popenfile(path='/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_dflat_nrs1_f_01.03.fits', fd=49, position=680480640, mode='r', flags=557056)
Closing file: popenfile(path='/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_FS_sflat_G395H_OPAQUE_FLAT3_nrs1_f_01.01.fits', fd=58, position=50964480, mode='r', flags=557056)
Closing file: popenfile(path='/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_FS_fflat_F290LP_01.01.fits', fd=59, position=420480, mode='r', flags=557056)
Closing file: popenfile(path='/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/fs_fullframe_g395h_f290lp_nrs1_interpolatedflat.fits', fd=60, position=4181760, mode='r', flags=557056)
Testing files for detector: nrs2
Working with uncal_file: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/fs_fullframe_g395h_f290lp_nrs2_uncal.fits
2021-04-23 15:37:39,430 - stpipe - INFO - PARS-DETECTOR1PIPELINE parameters found: /grp/crds/cache/references/jwst/jwst_nirspec_pars-detector1pipeline_0004.asdf
2021-04-23 15:37:39,448 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2021-04-23 15:37:39,449 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2021-04-23 15:37:39,450 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2021-04-23 15:37:39,452 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2021-04-23 15:37:39,453 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2021-04-23 15:37:39,454 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2021-04-23 15:37:39,455 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2021-04-23 15:37:39,457 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2021-04-23 15:37:39,458 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2021-04-23 15:37:39,459 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2021-04-23 15:37:39,460 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2021-04-23 15:37:39,462 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2021-04-23 15:37:39,463 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2021-04-23 15:37:39,464 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2021-04-23 15:37:39,465 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2021-04-23 15:37:39,466 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2021-04-23 15:37:39,468 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/stpipe/step.py:359: ResourceWarning: unclosed file <_io.FileIO name='fs_fullframe_g395h_f290lp_nrs1_interpolatedflat.fits' mode='rb' closefd=True>
gc.collect()
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/stpipe/step.py:359: ResourceWarning: unclosed file <_io.FileIO name='/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/fs_fullframe_g395h_f290lp_nrs2_uncal.fits' mode='rb' closefd=True>
gc.collect()
2021-04-23 15:37:39,839 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/fs_fullframe_g395h_f290lp_nrs2_uncal.fits',).
2021-04-23 15:37:39,849 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 4.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 200.0, 'min_jump_to_flag_neighbors': 10.0}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2021-04-23 15:37:39,988 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'fs_fullframe_g395h_f290lp_nrs2_uncal.fits' reftypes = ['dark', 'gain', 'linearity', 'mask', 'persat', 'readnoise', 'refpix', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2021-04-23 15:37:39,997 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_dark_0087.fits'.
2021-04-23 15:37:39,999 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_gain_0018.fits'.
2021-04-23 15:37:40,000 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_linearity_0021.fits'.
2021-04-23 15:37:40,002 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_mask_0011.fits'.
2021-04-23 15:37:40,004 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2021-04-23 15:37:40,004 - stpipe.Detector1Pipeline - INFO - Prefetch for READNOISE reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0017.fits'.
2021-04-23 15:37:40,006 - stpipe.Detector1Pipeline - INFO - Prefetch for REFPIX reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_refpix_0020.fits'.
2021-04-23 15:37:40,007 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is 'N/A'.
2021-04-23 15:37:40,008 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is 'N/A'.
2021-04-23 15:37:40,008 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_saturation_0021.fits'.
2021-04-23 15:37:40,009 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_superbias_0114.fits'.
2021-04-23 15:37:40,011 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2021-04-23 15:37:40,011 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2021-04-23 15:37:40,012 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2021-04-23 15:37:40,547 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(1, 7, 3200, 2048) from fs_fullframe_g395h_f290lp_nrs2_uncal.fits>,).
2021-04-23 15:37:40,549 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:37:41,123 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES and FRMDIVSR are equal; correction not needed
2021-04-23 15:37:41,124 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2021-04-23 15:37:41,125 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2021-04-23 15:37:41,334 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(1, 7, 3200, 2048) from fs_fullframe_g395h_f290lp_nrs2_uncal.fits>,).
2021-04-23 15:37:41,336 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:37:41,354 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_nirspec_mask_0011.fits
2021-04-23 15:37:42,002 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2021-04-23 15:37:42,263 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(1, 7, 3200, 2048) from fs_fullframe_g395h_f290lp_nrs2_uncal.fits>,).
2021-04-23 15:37:42,264 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:37:42,286 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_nirspec_saturation_0021.fits
2021-04-23 15:37:43,229 - stpipe.Detector1Pipeline.saturation - INFO - Detected 6420 saturated pixels
2021-04-23 15:37:43,309 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2021-04-23 15:37:43,335 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2021-04-23 15:37:43,587 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(1, 7, 3200, 2048) from fs_fullframe_g395h_f290lp_nrs2_uncal.fits>,).
2021-04-23 15:37:43,588 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:37:43,589 - stpipe.Detector1Pipeline.ipc - INFO - Step skipped.
2021-04-23 15:37:43,589 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2021-04-23 15:37:43,822 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias running with args (<RampModel(1, 7, 3200, 2048) from fs_fullframe_g395h_f290lp_nrs2_uncal.fits>,).
2021-04-23 15:37:43,824 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:37:43,841 - stpipe.Detector1Pipeline.superbias - INFO - Using SUPERBIAS reference file /grp/crds/cache/references/jwst/jwst_nirspec_superbias_0114.fits
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/stdatamodels/validate.py:34: ValidationWarning: While validating meta.exposure.readpatt the following error occurred:
'ALLIRS2' is not one of ['ACQ1', 'ACQ2', 'BRIGHT1', 'BRIGHT2', 'DEEP2', 'DEEP8', 'FAST', 'FASTGRPAVG', 'FASTGRPAVG8', 'FASTGRPAVG16', 'FASTGRPAVG32', 'FASTGRPAVG64', 'FASTR1', 'FASTR100', 'FGS', 'FGS60', 'FGS8370', 'FGS840', 'FGSRAPID', 'FINEGUIDE', 'ID', 'MEDIUM2', 'MEDIUM8', 'NIS', 'NISRAPID', 'NRS', 'NRSIRS2', 'NRSN16R4', 'NRSN32R8', 'NRSN8R2', 'NRSRAPID', 'NRSIRS2RAPID', 'NRSRAPIDD1', 'NRSRAPIDD2', 'NRSRAPIDD6', 'NRSSLOW', 'RAPID', 'SHALLOW2', 'SHALLOW4', 'SLOW', 'SLOWR1', 'TRACK', 'ANY', 'N/A']
Failed validating 'enum' in schema:
OrderedDict([('title', 'Readout pattern'),
('type', 'string'),
('enum',
['ACQ1',
'ACQ2',
'BRIGHT1',
'BRIGHT2',
'DEEP2',
'DEEP8',
'FAST',
'FASTGRPAVG',
'FASTGRPAVG8',
'FASTGRPAVG16',
'FASTGRPAVG32',
'FASTGRPAVG64',
'FASTR1',
'FASTR100',
'FGS',
'FGS60',
'FGS8370',
'FGS840',
'FGSRAPID',
'FINEGUIDE',
'ID',
'MEDIUM2',
'MEDIUM8',
'NIS',
'NISRAPID',
'NRS',
'NRSIRS2',
'NRSN16R4',
'NRSN32R8',
'NRSN8R2',
'NRSRAPID',
'NRSIRS2RAPID',
'NRSRAPIDD1',
'NRSRAPIDD2',
'NRSRAPIDD6',
'NRSSLOW',
'RAPID',
'SHALLOW2',
'SHALLOW4',
'SLOW',
'SLOWR1',
'TRACK',
'ANY',
'N/A']),
('fits_ke ...
warnings.warn(errmsg, ValidationWarning)
2021-04-23 15:37:44,680 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias done
2021-04-23 15:37:44,957 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(1, 7, 3200, 2048) from fs_fullframe_g395h_f290lp_nrs2_uncal.fits>,).
2021-04-23 15:37:44,959 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2021-04-23 15:37:44,981 - stpipe.Detector1Pipeline.refpix - INFO - Using refpix reference file: /grp/crds/cache/references/jwst/jwst_nirspec_refpix_0020.fits
2021-04-23 15:38:07,609 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2021-04-23 15:38:07,996 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(1, 7, 3200, 2048) from fs_fullframe_g395h_f290lp_nrs2_uncal.fits>,).
2021-04-23 15:38:07,998 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:38:08,015 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_nirspec_linearity_0021.fits
2021-04-23 15:38:08,923 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2021-04-23 15:38:09,127 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(1, 7, 3200, 2048) from fs_fullframe_g395h_f290lp_nrs2_uncal.fits>,).
2021-04-23 15:38:09,128 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4', 'dark_output': None}
2021-04-23 15:38:09,146 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_nirspec_dark_0087.fits
2021-04-23 15:38:12,891 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=1, ngroups=7, nframes=1, groupgap=0
2021-04-23 15:38:12,891 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=1, ngroups=65, nframes=1, groupgap=0
2021-04-23 15:38:13,473 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2021-04-23 15:38:14,194 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(1, 7, 3200, 2048) from fs_fullframe_g395h_f290lp_nrs2_uncal.fits>,).
2021-04-23 15:38:14,196 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4', 'rejection_threshold': 4.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 200.0, 'min_jump_to_flag_neighbors': 10.0}
2021-04-23 15:38:14,204 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 4 sigma
2021-04-23 15:38:14,215 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0018.fits
2021-04-23 15:38:14,254 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0017.fits
2021-04-23 15:38:14,289 - stpipe.Detector1Pipeline.jump - INFO - Found 32 possible cores to use for jump detection
2021-04-23 15:38:14,548 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2021-04-23 15:38:14,840 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
2021-04-23 15:38:16,303 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 47875 pixels with at least one CR
2021-04-23 15:38:17,749 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 3.2006 sec
2021-04-23 15:38:17,753 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 3.548713
2021-04-23 15:38:17,754 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2021-04-23 15:38:17,922 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(1, 7, 3200, 2048) from fs_fullframe_g395h_f290lp_nrs2_uncal.fits>,).
2021-04-23 15:38:17,923 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}
2021-04-23 15:38:17,948 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0017.fits
2021-04-23 15:38:17,981 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0018.fits
2021-04-23 15:38:18,017 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2021-04-23 15:38:18,018 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/jwst/ramp_fitting/ramp_fit.py:872: RuntimeWarning: invalid value encountered in multiply
var_p4[num_int,:,:,:] *= ( segs_4[num_int,:,:,:] > 0)
2021-04-23 15:38:49,004 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 7
2021-04-23 15:38:49,004 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 1
2021-04-23 15:38:49,112 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2021-04-23 15:38:49,279 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<ImageModel(2048, 2048) from fs_fullframe_g395h_f290lp_nrs2_uncal.fits>,).
2021-04-23 15:38:49,280 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:38:49,342 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2021-04-23 15:38:49,343 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2021-04-23 15:38:49,344 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2021-04-23 15:38:49,466 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(1, 2048, 2048) from fs_fullframe_g395h_f290lp_nrs2_uncal.fits>,).
2021-04-23 15:38:49,467 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:38:49,513 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2021-04-23 15:38:49,514 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2021-04-23 15:38:49,515 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2021-04-23 15:38:49,515 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2021-04-23 15:38:49,516 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2021-04-23 15:38:49,524 - stpipe.AssignWcsStep - INFO - AssignWcsStep instance created.
2021-04-23 15:38:49,655 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep running with args (<ImageModel(2048, 2048) from fs_fullframe_g395h_f290lp_nrs2_uncal.fits>,).
2021-04-23 15:38:49,657 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2021-04-23 15:38:49,822 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.1448970586061478 deg
2021-04-23 15:38:49,823 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3232757747173309 deg
2021-04-23 15:38:49,823 - stpipe.AssignWcsStep - INFO - theta_y correction: -3.766823889842878e-13 deg
2021-04-23 15:38:49,824 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2021-04-23 15:38:50,032 - stpipe.AssignWcsStep - INFO - Slits projected on detector NRS2: ['S200A1', 'S200A2', 'S400A1', 'S1600A1', 'S200B1']
2021-04-23 15:38:50,033 - stpipe.AssignWcsStep - INFO - Computing WCS for 5 open slitlets
2021-04-23 15:38:50,052 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.1448970586061478 deg
2021-04-23 15:38:50,053 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3232757747173309 deg
2021-04-23 15:38:50,053 - stpipe.AssignWcsStep - INFO - theta_y correction: -3.766823889842878e-13 deg
2021-04-23 15:38:50,054 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2021-04-23 15:38:50,067 - stpipe.AssignWcsStep - INFO - SPORDER= -1, wrange=[2.87e-06, 5.27e-06]
2021-04-23 15:38:50,173 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 1
2021-04-23 15:38:50,174 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 2
2021-04-23 15:38:50,174 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 3
2021-04-23 15:38:50,175 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 4
2021-04-23 15:38:50,175 - stpipe.AssignWcsStep - INFO - There are 5 open slits in quadrant 5
2021-04-23 15:38:50,321 - stpipe.AssignWcsStep - INFO - Created a NIRSPEC nrs_fixedslit pipeline with references {'distortion': None, 'filteroffset': None, 'specwcs': None, 'regions': None, 'wavelengthrange': '/grp/crds/cache/references/jwst/jwst_nirspec_wavelengthrange_0004.asdf', 'camera': '/grp/crds/cache/references/jwst/jwst_nirspec_camera_0004.asdf', 'collimator': '/grp/crds/cache/references/jwst/jwst_nirspec_collimator_0004.asdf', 'disperser': '/grp/crds/cache/references/jwst/jwst_nirspec_disperser_0035.asdf', 'fore': '/grp/crds/cache/references/jwst/jwst_nirspec_fore_0022.asdf', 'fpa': '/grp/crds/cache/references/jwst/jwst_nirspec_fpa_0005.asdf', 'msa': '/grp/crds/cache/references/jwst/jwst_nirspec_msa_0005.asdf', 'ote': '/grp/crds/cache/references/jwst/jwst_nirspec_ote_0005.asdf', 'ifupost': None, 'ifufore': None, 'ifuslicer': None}
2021-04-23 15:38:50,481 - stpipe.AssignWcsStep - INFO - COMPLETED assign_wcs
2021-04-23 15:38:50,484 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep done
2021-04-23 15:38:50,492 - stpipe.Extract2dStep - INFO - Extract2dStep instance created.
2021-04-23 15:38:50,638 - stpipe.Extract2dStep - INFO - Step Extract2dStep running with args (<ImageModel(2048, 2048) from fs_fullframe_g395h_f290lp_nrs2_uncal.fits>,).
2021-04-23 15:38:50,640 - stpipe.Extract2dStep - INFO - Step Extract2dStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'slit_name': None, 'extract_orders': None, 'tsgrism_extract_height': None, 'wfss_extract_half_height': 5, 'grism_objects': None, 'mmag_extract': 99.0}
2021-04-23 15:38:50,654 - stpipe.Extract2dStep - INFO - EXP_TYPE is NRS_FIXEDSLIT
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/gwcs/utils.py:72: DeprecationWarning: `np.int` is a deprecated alias for the builtin `int`. To silence this warning, use `int` by itself. Doing this will not modify any behavior and is safe. When replacing `np.int`, you may wish to use e.g. `np.int64` or `np.int32` to specify the precision. If you wish to review your current use, check the release note link for additional information.
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
indx = np.asarray(np.floor(np.asarray(value) + 0.5), dtype=np.int)
2021-04-23 15:38:50,831 - stpipe.Extract2dStep - INFO - Name of subarray extracted: S200A1
2021-04-23 15:38:50,832 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 2048
2021-04-23 15:38:50,832 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1060 1122
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/gwcs/geometry.py:203: RuntimeWarning: invalid value encountered in remainder
lon = np.mod(lon, 360.0 * u.deg if nquant else 360.0)
2021-04-23 15:38:51,023 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:38:51,031 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.191685737 -45.682908511 156.190837415 -45.682092120 156.190771015 -45.682126390 156.191619323 -45.682942792
2021-04-23 15:38:51,032 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.191685737 -45.682908511 156.190837415 -45.682092120 156.190771015 -45.682126390 156.191619323 -45.682942792
2021-04-23 15:38:51,187 - stpipe.Extract2dStep - INFO - Name of subarray extracted: S200A2
2021-04-23 15:38:51,188 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 2048
2021-04-23 15:38:51,188 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1023 1081
2021-04-23 15:38:51,365 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:38:51,373 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.184519149 -45.685298792 156.183675453 -45.684484578 156.183609578 -45.684518640 156.184453260 -45.685332865
2021-04-23 15:38:51,373 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.184519149 -45.685298792 156.183675453 -45.684484578 156.183609578 -45.684518640 156.184453260 -45.685332865
2021-04-23 15:38:51,526 - stpipe.Extract2dStep - INFO - Name of subarray extracted: S400A1
2021-04-23 15:38:51,527 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 2048
2021-04-23 15:38:51,527 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 984 1049
2021-04-23 15:38:51,883 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:38:51,891 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.187759056 -45.682331806 156.186793281 -45.681401531 156.186663358 -45.681468621 156.187629101 -45.682398919
2021-04-23 15:38:51,892 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.187759056 -45.682331806 156.186793281 -45.681401531 156.186663358 -45.681468621 156.187629101 -45.682398919
2021-04-23 15:38:52,044 - stpipe.Extract2dStep - INFO - Name of subarray extracted: S1600A1
2021-04-23 15:38:52,044 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 2048
2021-04-23 15:38:52,045 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 964 1006
2021-04-23 15:38:52,197 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:38:52,205 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.187720636 -45.680802803 156.187307671 -45.680405209 156.186792650 -45.680671077 156.187205560 -45.681068709
2021-04-23 15:38:52,205 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.187720636 -45.680802803 156.187307671 -45.680405209 156.186792650 -45.680671077 156.187205560 -45.681068709
2021-04-23 15:38:52,357 - stpipe.Extract2dStep - INFO - Name of subarray extracted: S200B1
2021-04-23 15:38:52,357 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 140 2048
2021-04-23 15:38:52,358 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 925 1037
2021-04-23 15:38:52,606 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:38:52,614 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.238745821 -45.653926065 156.237887188 -45.653118339 156.237822146 -45.653151380 156.238680762 -45.653959111
2021-04-23 15:38:52,614 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.238745821 -45.653926065 156.237887188 -45.653118339 156.237822146 -45.653151380 156.238680762 -45.653959111
2021-04-23 15:38:52,741 - stpipe.Extract2dStep - INFO - Step Extract2dStep done
2021-04-23 15:38:52,848 - stpipe.SourceTypeStep - INFO - SourceTypeStep instance created.
2021-04-23 15:38:52,998 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep running with args (<MultiSlitModel from fs_fullframe_g395h_f290lp_nrs2_uncal.fits>,).
2021-04-23 15:38:52,999 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-04-23 15:38:53,006 - stpipe.SourceTypeStep - INFO - Input EXP_TYPE is NRS_FIXEDSLIT
2021-04-23 15:38:53,006 - stpipe.SourceTypeStep - INFO - Input SRCTYAPT = UNKNOWN
2021-04-23 15:38:53,007 - stpipe.SourceTypeStep - INFO - Input source type is unknown; setting default SRCTYPE = POINT
2021-04-23 15:38:53,008 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep done
2021-04-23 15:38:53,024 - stpipe.WavecorrStep - INFO - WavecorrStep instance created.
2021-04-23 15:38:53,145 - stpipe.WavecorrStep - INFO - Step WavecorrStep running with args (<MultiSlitModel from fs_fullframe_g395h_f290lp_nrs2_uncal.fits>,).
2021-04-23 15:38:53,147 - stpipe.WavecorrStep - INFO - Step WavecorrStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-04-23 15:38:53,172 - stpipe.WavecorrStep - INFO - Using WAVECORR reference file /grp/crds/cache/references/jwst/jwst_nirspec_wavecorr_0001.asdf
2021-04-23 15:38:53,733 - stpipe.WavecorrStep - INFO - Detected a POINT source type in slit S200A1
2021-04-23 15:38:53,735 - stpipe.AssignWcsStep - INFO - AssignWcsStep instance created.
2021-04-23 15:38:54,006 - stpipe.WavecorrStep - INFO - Using wavelength zero-point correction for aperture S200A1
2021-04-23 15:38:54,019 - stpipe.WavecorrStep - INFO - Step WavecorrStep done
2021-04-23 15:38:54,037 - stpipe.FlatFieldStep - INFO - FlatFieldStep instance created.
2021-04-23 15:38:54,206 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep running with args (<MultiSlitModel from fs_fullframe_g395h_f290lp_nrs2_uncal.fits>,).
2021-04-23 15:38:54,208 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': True, 'user_supplied_flat': None, 'inverse': False}
2021-04-23 15:38:55,461 - stpipe.FlatFieldStep - INFO - Working on slit S200A1
2021-04-23 15:38:55,463 - stpipe.FlatFieldStep - INFO - Creating wavelength array from WCS for slit S200A1
2021-04-23 15:39:26,860 - stpipe.FlatFieldStep - INFO - Working on slit S200A2
2021-04-23 15:39:42,662 - stpipe.FlatFieldStep - INFO - Working on slit S400A1
2021-04-23 15:40:00,511 - stpipe.FlatFieldStep - INFO - Working on slit S1600A1
2021-04-23 15:40:08,504 - stpipe.FlatFieldStep - INFO - Working on slit S200B1
2021-04-23 15:40:24,333 - stpipe.FlatFieldStep - INFO - Saved model in fs_fullframe_g395h_f290lp_nrs2_interpolatedflat.fits
2021-04-23 15:40:24,335 - stpipe.FlatFieldStep - INFO - Interpolated flat written to "fs_fullframe_g395h_f290lp_nrs2_interpolatedflat.fits".
2021-04-23 15:40:24,336 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep done
Running flat field test for FS... Filename: fs_fullframe_g395h_f290lp_nrs2_interpolatedflat.fits No. Name Ver Type Cards Dimensions Format 0 PRIMARY 1 PrimaryHDU 281 () 1 SCI 1 ImageHDU 14 (2048, 62) float32 2 DQ 1 ImageHDU 11 (2048, 62) int32 (rescales to uint32) 3 ERR 1 ImageHDU 9 (2048, 62) float32 4 WAVELENGTH 1 ImageHDU 9 (2048, 62) float32 5 SCI 2 ImageHDU 14 (2048, 58) float32 6 DQ 2 ImageHDU 11 (2048, 58) int32 (rescales to uint32) 7 ERR 2 ImageHDU 9 (2048, 58) float32 8 WAVELENGTH 2 ImageHDU 9 (2048, 58) float32 9 SCI 3 ImageHDU 14 (2048, 65) float32 10 DQ 3 ImageHDU 11 (2048, 65) int32 (rescales to uint32) 11 ERR 3 ImageHDU 9 (2048, 65) float32 12 WAVELENGTH 3 ImageHDU 9 (2048, 65) float32 13 SCI 4 ImageHDU 14 (2048, 42) float32 14 DQ 4 ImageHDU 11 (2048, 42) int32 (rescales to uint32) 15 ERR 4 ImageHDU 9 (2048, 42) float32 16 WAVELENGTH 4 ImageHDU 9 (2048, 42) float32 17 SCI 5 ImageHDU 14 (1908, 112) float32 18 DQ 5 ImageHDU 11 (1908, 112) int32 (rescales to uint32) 19 ERR 5 ImageHDU 9 (1908, 112) float32 20 WAVELENGTH 5 ImageHDU 9 (1908, 112) float32 21 ASDF 1 BinTableHDU 11 1R x 1C [296296B]
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/gwcs/geometry.py:203: RuntimeWarning: invalid value encountered in remainder lon = np.mod(lon, 360.0 * u.deg if nquant else 360.0)
flat_field_file --> Grating:G395H Filter:F290LP LAMP:LINE3
Using D-flat: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_dflat_nrs2_f_01.03.fits
Using S-flat: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_FS_sflat_G395H_OPAQUE_FLAT3_nrs2_f_01.01.fits
Using F-flat: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_FS_fflat_F290LP_01.01.fits
Now looping through the slits. This may take a while...
Working with slit: S200A1
exp_type = NRS_FIXEDSLIT
SCI ext = 1
Subwindow origin: px0=1 py0=1061
Looping through the wavelengths...
Calculating statistics...
Absolute Flat Difference : mean = 5.806e-07 median = -4.025e-08 stdev = 1.899e-04
Maximum AbsoluteFlat Difference = 1.695e-02
Minimum AbsoluteFlat Difference = -4.542e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 40%
-> 3xtheshold = 6%
-> 5xtheshold = 1%
*** Result of the test: PASSED
No output_directory was provided. Figures will be saved in current working directory:
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/FS_flattest_NRS2_S200A1_histogram.png
Working with slit: S200A2
exp_type = NRS_FIXEDSLIT
SCI ext = 2
Subwindow origin: px0=1 py0=1024
Looping through the wavelengths...
Calculating statistics...
Absolute Flat Difference : mean = 1.458e-06 median = -6.009e-08 stdev = 4.070e-04
Maximum AbsoluteFlat Difference = 9.938e-02
Minimum AbsoluteFlat Difference = -1.637e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 37%
-> 3xtheshold = 5%
-> 5xtheshold = 1%
*** Result of the test: PASSED
No output_directory was provided. Figures will be saved in current working directory:
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/FS_flattest_NRS2_S200A2_histogram.png
Working with slit: S400A1
exp_type = NRS_FIXEDSLIT
SCI ext = 3
Subwindow origin: px0=1 py0=985
Looping through the wavelengths...
Calculating statistics...
Absolute Flat Difference : mean = 9.234e-07 median = -5.637e-08 stdev = 3.560e-04
Maximum AbsoluteFlat Difference = 4.536e-03
Minimum AbsoluteFlat Difference = -6.026e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 60%
-> 3xtheshold = 26%
-> 5xtheshold = 10%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
*** Result of the test: PASSED
No output_directory was provided. Figures will be saved in current working directory:
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/FS_flattest_NRS2_S400A1_histogram.png
Working with slit: S1600A1
exp_type = NRS_FIXEDSLIT
SCI ext = 4
Subwindow origin: px0=1 py0=965
Looping through the wavelengths...
Calculating statistics...
Absolute Flat Difference : mean = 5.116e-06 median = -7.235e-07 stdev = 2.355e-03
Maximum AbsoluteFlat Difference = 3.507e-02
Minimum AbsoluteFlat Difference = -3.697e-02
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 91%
-> 3xtheshold = 79%
-> 5xtheshold = 69%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
*** WARNING: More than 10% of pixels have a median value greater than 5xthreshold!
*** Result of the test: PASSED
No output_directory was provided. Figures will be saved in current working directory:
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/FS_flattest_NRS2_S1600A1_histogram.png
Working with slit: S200B1
exp_type = NRS_FIXEDSLIT
SCI ext = 5
Subwindow origin: px0=141 py0=926
Looping through the wavelengths...
Calculating statistics...
Absolute Flat Difference : mean = 3.218e-07 median = 5.067e-08 stdev = 3.199e-04
Maximum AbsoluteFlat Difference = 8.327e-03
Minimum AbsoluteFlat Difference = -7.312e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 45%
-> 3xtheshold = 10%
-> 5xtheshold = 2%
*** Result of the test: PASSED
No output_directory was provided. Figures will be saved in current working directory:
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/FS_flattest_NRS2_S200B1_histogram.png
*** Final result for flat_field test will be reported as PASSED ***
('* Script flattest_fs.py took ', '6.323849340279897 minutes to finish.')
Did flat_field validation test passed? All slits PASSED flat_field test.
Testing files for detector: nrs1
<ipython-input-1-5fd6a242850b>:74: ResourceWarning: unclosed file <_io.FileIO name='fs_fullframe_g395h_f290lp_nrs2_interpolatedflat.fits' mode='rb' closefd=True> result, result_msg, log_msgs = nptt.calwebb_spec2_pytests.auxiliary_code.flattest_fs.flattest(
Working with uncal_file: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/mos_prism_nrs1_uncal.fits
2021-04-23 15:47:02,201 - stpipe - INFO - PARS-DETECTOR1PIPELINE parameters found: /grp/crds/cache/references/jwst/jwst_nirspec_pars-detector1pipeline_0004.asdf
2021-04-23 15:47:02,216 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2021-04-23 15:47:02,217 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2021-04-23 15:47:02,218 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2021-04-23 15:47:02,219 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2021-04-23 15:47:02,221 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2021-04-23 15:47:02,222 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2021-04-23 15:47:02,223 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2021-04-23 15:47:02,224 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2021-04-23 15:47:02,225 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2021-04-23 15:47:02,226 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2021-04-23 15:47:02,227 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2021-04-23 15:47:02,228 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2021-04-23 15:47:02,229 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2021-04-23 15:47:02,231 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2021-04-23 15:47:02,232 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2021-04-23 15:47:02,233 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2021-04-23 15:47:02,234 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/stpipe/step.py:359: ResourceWarning: unclosed file <_io.FileIO name='/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/mos_prism_nrs1_uncal.fits' mode='rb' closefd=True>
gc.collect()
2021-04-23 15:47:02,401 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/mos_prism_nrs1_uncal.fits',).
2021-04-23 15:47:02,410 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 4.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 200.0, 'min_jump_to_flag_neighbors': 10.0}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2021-04-23 15:47:02,499 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'mos_prism_nrs1_uncal.fits' reftypes = ['dark', 'gain', 'linearity', 'mask', 'persat', 'readnoise', 'refpix', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2021-04-23 15:47:02,508 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_dark_0086.fits'.
2021-04-23 15:47:02,509 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_gain_0019.fits'.
2021-04-23 15:47:02,511 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_linearity_0018.fits'.
2021-04-23 15:47:02,513 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_mask_0010.fits'.
2021-04-23 15:47:02,514 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2021-04-23 15:47:02,515 - stpipe.Detector1Pipeline - INFO - Prefetch for READNOISE reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0018.fits'.
2021-04-23 15:47:02,516 - stpipe.Detector1Pipeline - INFO - Prefetch for REFPIX reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_refpix_0022.fits'.
2021-04-23 15:47:02,517 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is 'N/A'.
2021-04-23 15:47:02,518 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is 'N/A'.
2021-04-23 15:47:02,518 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_saturation_0020.fits'.
2021-04-23 15:47:02,520 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_superbias_0113.fits'.
2021-04-23 15:47:02,521 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2021-04-23 15:47:02,521 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2021-04-23 15:47:02,522 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2021-04-23 15:47:02,785 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs1_uncal.fits>,).
2021-04-23 15:47:02,786 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:47:02,877 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES and FRMDIVSR are equal; correction not needed
2021-04-23 15:47:02,878 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2021-04-23 15:47:02,878 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2021-04-23 15:47:02,999 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs1_uncal.fits>,).
2021-04-23 15:47:03,000 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:47:03,017 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_nirspec_mask_0010.fits
2021-04-23 15:47:03,324 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2021-04-23 15:47:03,445 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs1_uncal.fits>,).
2021-04-23 15:47:03,446 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:47:03,462 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_nirspec_saturation_0020.fits
2021-04-23 15:47:03,944 - stpipe.Detector1Pipeline.saturation - INFO - Detected 9869 saturated pixels
2021-04-23 15:47:03,977 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2021-04-23 15:47:04,008 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2021-04-23 15:47:04,129 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs1_uncal.fits>,).
2021-04-23 15:47:04,130 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:47:04,131 - stpipe.Detector1Pipeline.ipc - INFO - Step skipped.
2021-04-23 15:47:04,132 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2021-04-23 15:47:04,245 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs1_uncal.fits>,).
2021-04-23 15:47:04,246 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:47:04,262 - stpipe.Detector1Pipeline.superbias - INFO - Using SUPERBIAS reference file /grp/crds/cache/references/jwst/jwst_nirspec_superbias_0113.fits
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/stdatamodels/validate.py:34: ValidationWarning: While validating meta.exposure.readpatt the following error occurred:
'ALLIRS2' is not one of ['ACQ1', 'ACQ2', 'BRIGHT1', 'BRIGHT2', 'DEEP2', 'DEEP8', 'FAST', 'FASTGRPAVG', 'FASTGRPAVG8', 'FASTGRPAVG16', 'FASTGRPAVG32', 'FASTGRPAVG64', 'FASTR1', 'FASTR100', 'FGS', 'FGS60', 'FGS8370', 'FGS840', 'FGSRAPID', 'FINEGUIDE', 'ID', 'MEDIUM2', 'MEDIUM8', 'NIS', 'NISRAPID', 'NRS', 'NRSIRS2', 'NRSN16R4', 'NRSN32R8', 'NRSN8R2', 'NRSRAPID', 'NRSIRS2RAPID', 'NRSRAPIDD1', 'NRSRAPIDD2', 'NRSRAPIDD6', 'NRSSLOW', 'RAPID', 'SHALLOW2', 'SHALLOW4', 'SLOW', 'SLOWR1', 'TRACK', 'ANY', 'N/A']
Failed validating 'enum' in schema:
OrderedDict([('title', 'Readout pattern'),
('type', 'string'),
('enum',
['ACQ1',
'ACQ2',
'BRIGHT1',
'BRIGHT2',
'DEEP2',
'DEEP8',
'FAST',
'FASTGRPAVG',
'FASTGRPAVG8',
'FASTGRPAVG16',
'FASTGRPAVG32',
'FASTGRPAVG64',
'FASTR1',
'FASTR100',
'FGS',
'FGS60',
'FGS8370',
'FGS840',
'FGSRAPID',
'FINEGUIDE',
'ID',
'MEDIUM2',
'MEDIUM8',
'NIS',
'NISRAPID',
'NRS',
'NRSIRS2',
'NRSN16R4',
'NRSN32R8',
'NRSN8R2',
'NRSRAPID',
'NRSIRS2RAPID',
'NRSRAPIDD1',
'NRSRAPIDD2',
'NRSRAPIDD6',
'NRSSLOW',
'RAPID',
'SHALLOW2',
'SHALLOW4',
'SLOW',
'SLOWR1',
'TRACK',
'ANY',
'N/A']),
('fits_ke ...
warnings.warn(errmsg, ValidationWarning)
2021-04-23 15:47:04,578 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias done
2021-04-23 15:47:04,700 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs1_uncal.fits>,).
2021-04-23 15:47:04,702 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2021-04-23 15:47:04,718 - stpipe.Detector1Pipeline.refpix - INFO - Using refpix reference file: /grp/crds/cache/references/jwst/jwst_nirspec_refpix_0022.fits
2021-04-23 15:47:20,981 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2021-04-23 15:47:21,307 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs1_uncal.fits>,).
2021-04-23 15:47:21,308 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:47:21,327 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_nirspec_linearity_0018.fits
2021-04-23 15:47:22,109 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2021-04-23 15:47:22,252 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs1_uncal.fits>,).
2021-04-23 15:47:22,254 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4', 'dark_output': None}
2021-04-23 15:47:22,271 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_nirspec_dark_0086.fits
2021-04-23 15:47:26,322 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=1, ngroups=4, nframes=1, groupgap=0
2021-04-23 15:47:26,323 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=1, ngroups=65, nframes=1, groupgap=0
2021-04-23 15:47:26,692 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2021-04-23 15:47:27,414 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs1_uncal.fits>,).
2021-04-23 15:47:27,416 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4', 'rejection_threshold': 4.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 200.0, 'min_jump_to_flag_neighbors': 10.0}
2021-04-23 15:47:27,424 - stpipe.Detector1Pipeline.jump - WARNING - Can not apply jump detection when NGROUPS<=4;
2021-04-23 15:47:27,425 - stpipe.Detector1Pipeline.jump - WARNING - Jump step will be skipped
2021-04-23 15:47:27,495 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2021-04-23 15:47:27,641 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs1_uncal.fits>,).
2021-04-23 15:47:27,643 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}
2021-04-23 15:47:27,669 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0018.fits
2021-04-23 15:47:27,708 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0019.fits
2021-04-23 15:47:27,747 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2021-04-23 15:47:27,748 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
2021-04-23 15:47:39,806 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 4
2021-04-23 15:47:39,807 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 1
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/jwst/ramp_fitting/ramp_fit.py:1091: RuntimeWarning: divide by zero encountered in true_divide
var_p2 = 1/(s_inv_var_p3.sum(axis=0))
2021-04-23 15:47:39,976 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2021-04-23 15:47:40,115 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<ImageModel(2048, 2048) from mos_prism_nrs1_uncal.fits>,).
2021-04-23 15:47:40,116 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:47:40,164 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2021-04-23 15:47:40,164 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2021-04-23 15:47:40,165 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2021-04-23 15:47:40,293 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(1, 2048, 2048) from mos_prism_nrs1_uncal.fits>,).
2021-04-23 15:47:40,294 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:47:40,341 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2021-04-23 15:47:40,342 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2021-04-23 15:47:40,343 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2021-04-23 15:47:40,344 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2021-04-23 15:47:40,344 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2021-04-23 15:47:40,353 - stpipe.AssignWcsStep - INFO - AssignWcsStep instance created.
2021-04-23 15:47:40,497 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep running with args (<ImageModel(2048, 2048) from mos_prism_nrs1_uncal.fits>,).
2021-04-23 15:47:40,499 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2021-04-23 15:47:40,627 - stpipe.AssignWcsStep - INFO - Retrieving open MSA slitlets for msa_metadata_id = 1 and dither_index = 1
2021-04-23 15:47:40,642 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.0332140289247036 deg
2021-04-23 15:47:40,642 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3367482721805573 deg
2021-04-23 15:47:40,643 - stpipe.AssignWcsStep - INFO - theta_y correction: -1.0907214098475986e-05 deg
2021-04-23 15:47:40,644 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2021-04-23 15:47:40,833 - stpipe.AssignWcsStep - INFO - Slits projected on detector NRS1: [3, 4]
2021-04-23 15:47:40,834 - stpipe.AssignWcsStep - INFO - Computing WCS for 2 open slitlets
2021-04-23 15:47:40,846 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.0332140289247036 deg
2021-04-23 15:47:40,847 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3367482721805573 deg
2021-04-23 15:47:40,847 - stpipe.AssignWcsStep - INFO - theta_y correction: -1.0907214098475986e-05 deg
2021-04-23 15:47:40,848 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2021-04-23 15:47:40,855 - stpipe.AssignWcsStep - INFO - SPORDER= 0, wrange=[6e-07, 5.3e-06]
2021-04-23 15:47:40,946 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 1
2021-04-23 15:47:40,946 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 2
2021-04-23 15:47:40,947 - stpipe.AssignWcsStep - INFO - There are 1 open slits in quadrant 3
2021-04-23 15:47:40,956 - stpipe.AssignWcsStep - INFO - There are 1 open slits in quadrant 4
2021-04-23 15:47:40,965 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 5
2021-04-23 15:47:41,065 - stpipe.AssignWcsStep - INFO - Created a NIRSPEC nrs_msaspec pipeline with references {'distortion': None, 'filteroffset': None, 'specwcs': None, 'regions': None, 'wavelengthrange': '/grp/crds/cache/references/jwst/jwst_nirspec_wavelengthrange_0004.asdf', 'camera': '/grp/crds/cache/references/jwst/jwst_nirspec_camera_0004.asdf', 'collimator': '/grp/crds/cache/references/jwst/jwst_nirspec_collimator_0004.asdf', 'disperser': '/grp/crds/cache/references/jwst/jwst_nirspec_disperser_0034.asdf', 'fore': '/grp/crds/cache/references/jwst/jwst_nirspec_fore_0028.asdf', 'fpa': '/grp/crds/cache/references/jwst/jwst_nirspec_fpa_0005.asdf', 'msa': '/grp/crds/cache/references/jwst/jwst_nirspec_msa_0005.asdf', 'ote': '/grp/crds/cache/references/jwst/jwst_nirspec_ote_0005.asdf', 'ifupost': None, 'ifufore': None, 'ifuslicer': None, 'msametafile': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/V0030006000104_msa.fits'}
2021-04-23 15:47:41,193 - stpipe.AssignWcsStep - INFO - COMPLETED assign_wcs
2021-04-23 15:47:41,196 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep done
2021-04-23 15:47:41,205 - stpipe.MSAFlagOpenStep - INFO - MSAFlagOpenStep instance created.
2021-04-23 15:47:41,366 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep running with args (<ImageModel(2048, 2048) from mos_prism_nrs1_uncal.fits>,).
2021-04-23 15:47:41,368 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-04-23 15:47:41,383 - stpipe.MSAFlagOpenStep - INFO - Using reference file /grp/crds/cache/references/jwst/jwst_nirspec_msaoper_0001.json
2021-04-23 15:47:41,384 - stpipe.JwstStep - INFO - JwstStep instance created.
2021-04-23 15:47:41,489 - stpipe.MSAFlagOpenStep - INFO - gwa_ytilt is 0.0332140289247036 deg
2021-04-23 15:47:41,490 - stpipe.MSAFlagOpenStep - INFO - gwa_xtilt is 0.3367482721805573 deg
2021-04-23 15:47:41,491 - stpipe.MSAFlagOpenStep - INFO - theta_y correction: -1.0907214098475986e-05 deg
2021-04-23 15:47:41,491 - stpipe.MSAFlagOpenStep - INFO - theta_x correction: 0.0 deg
2021-04-23 15:47:41,498 - stpipe.MSAFlagOpenStep - INFO - SPORDER= 0, wrange=[6e-07, 5.3e-06]
2021-04-23 15:47:41,588 - stpipe.MSAFlagOpenStep - INFO - There are 5 open slits in quadrant 1
2021-04-23 15:47:41,628 - stpipe.MSAFlagOpenStep - INFO - There are 3 open slits in quadrant 2
2021-04-23 15:47:41,653 - stpipe.MSAFlagOpenStep - INFO - There are 9 open slits in quadrant 3
2021-04-23 15:47:41,725 - stpipe.MSAFlagOpenStep - INFO - There are 3 open slits in quadrant 4
2021-04-23 15:47:41,749 - stpipe.MSAFlagOpenStep - INFO - There are 0 open slits in quadrant 5
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/gwcs/geometry.py:203: RuntimeWarning: invalid value encountered in remainder
lon = np.mod(lon, 360.0 * u.deg if nquant else 360.0)
2021-04-23 15:47:52,531 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep done
2021-04-23 15:47:52,542 - stpipe.Extract2dStep - INFO - Extract2dStep instance created.
2021-04-23 15:47:52,806 - stpipe.Extract2dStep - INFO - Step Extract2dStep running with args (<ImageModel(2048, 2048) from mos_prism_nrs1_uncal.fits>,).
2021-04-23 15:47:52,808 - stpipe.Extract2dStep - INFO - Step Extract2dStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'slit_name': None, 'extract_orders': None, 'tsgrism_extract_height': None, 'wfss_extract_half_height': 5, 'grism_objects': None, 'mmag_extract': 99.0}
2021-04-23 15:47:52,824 - stpipe.Extract2dStep - INFO - EXP_TYPE is NRS_MSASPEC
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/gwcs/utils.py:72: DeprecationWarning: `np.int` is a deprecated alias for the builtin `int`. To silence this warning, use `int` by itself. Doing this will not modify any behavior and is safe. When replacing `np.int`, you may wish to use e.g. `np.int64` or `np.int32` to specify the precision. If you wish to review your current use, check the release note link for additional information.
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
indx = np.asarray(np.floor(np.asarray(value) + 0.5), dtype=np.int)
2021-04-23 15:47:52,976 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 3
2021-04-23 15:47:52,977 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 1027 1464
2021-04-23 15:47:52,977 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1971 1983
2021-04-23 15:47:53,080 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:47:53,089 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.216281195 -45.702862740 156.216151591 -45.702738206 156.216089149 -45.702770462 156.216218751 -45.702894998
2021-04-23 15:47:53,089 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.216281195 -45.702862740 156.216151591 -45.702738206 156.216089149 -45.702770462 156.216218751 -45.702894998
2021-04-23 15:47:53,226 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 4
2021-04-23 15:47:53,227 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 1275 1699
2021-04-23 15:47:53,227 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 32 43
2021-04-23 15:47:53,333 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:47:53,341 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.168120618 -45.657220874 156.167995139 -45.657100409 156.167933468 -45.657132147 156.168058946 -45.657252613
2021-04-23 15:47:53,342 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.168120618 -45.657220874 156.167995139 -45.657100409 156.167933468 -45.657132147 156.168058946 -45.657252613
2021-04-23 15:47:53,398 - stpipe.Extract2dStep - INFO - Step Extract2dStep done
2021-04-23 15:47:53,424 - stpipe.SourceTypeStep - INFO - SourceTypeStep instance created.
2021-04-23 15:47:53,578 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep running with args (<MultiSlitModel from mos_prism_nrs1_uncal.fits>,).
2021-04-23 15:47:53,579 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-04-23 15:47:53,587 - stpipe.SourceTypeStep - INFO - Input EXP_TYPE is NRS_MSASPEC
2021-04-23 15:47:53,588 - stpipe.SourceTypeStep - INFO - source_id=3, stellarity=100.0000, type=POINT
2021-04-23 15:47:53,588 - stpipe.SourceTypeStep - INFO - source_id=4, stellarity=100.0000, type=POINT
2021-04-23 15:47:53,589 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep done
2021-04-23 15:47:53,602 - stpipe.WavecorrStep - INFO - WavecorrStep instance created.
2021-04-23 15:47:53,736 - stpipe.WavecorrStep - INFO - Step WavecorrStep running with args (<MultiSlitModel from mos_prism_nrs1_uncal.fits>,).
2021-04-23 15:47:53,737 - stpipe.WavecorrStep - INFO - Step WavecorrStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-04-23 15:47:53,758 - stpipe.WavecorrStep - INFO - Using WAVECORR reference file /grp/crds/cache/references/jwst/jwst_nirspec_wavecorr_0002.asdf
2021-04-23 15:47:54,027 - stpipe.WavecorrStep - INFO - Detected a POINT source type in slit 3
2021-04-23 15:47:54,078 - stpipe.WavecorrStep - INFO - Using wavelength zero-point correction for aperture MOS
2021-04-23 15:47:54,081 - stpipe.WavecorrStep - INFO - Detected a POINT source type in slit 4
2021-04-23 15:47:54,131 - stpipe.WavecorrStep - INFO - Using wavelength zero-point correction for aperture MOS
2021-04-23 15:47:54,133 - stpipe.WavecorrStep - INFO - Step WavecorrStep done
2021-04-23 15:47:54,146 - stpipe.FlatFieldStep - INFO - FlatFieldStep instance created.
2021-04-23 15:47:54,302 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep running with args (<MultiSlitModel from mos_prism_nrs1_uncal.fits>,).
2021-04-23 15:47:54,304 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': True, 'user_supplied_flat': None, 'inverse': False}
2021-04-23 15:48:02,666 - stpipe.FlatFieldStep - INFO - Working on slit 3
2021-04-23 15:48:03,311 - stpipe.FlatFieldStep - INFO - Working on slit 4
2021-04-23 15:48:04,284 - stpipe.FlatFieldStep - INFO - Saved model in mos_prism_nrs1_interpolatedflat.fits
2021-04-23 15:48:04,285 - stpipe.FlatFieldStep - INFO - Interpolated flat written to "mos_prism_nrs1_interpolatedflat.fits".
2021-04-23 15:48:04,286 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep done
Running flat field test for MOS... Filename: mos_prism_nrs1_interpolatedflat.fits No. Name Ver Type Cards Dimensions Format 0 PRIMARY 1 PrimaryHDU 282 () 1 SCI 1 ImageHDU 14 (437, 12) float32 2 DQ 1 ImageHDU 11 (437, 12) int32 (rescales to uint32) 3 ERR 1 ImageHDU 9 (437, 12) float32 4 WAVELENGTH 1 ImageHDU 9 (437, 12) float32 5 SCI 2 ImageHDU 14 (424, 11) float32 6 DQ 2 ImageHDU 11 (424, 11) int32 (rescales to uint32) 7 ERR 2 ImageHDU 9 (424, 11) float32 8 WAVELENGTH 2 ImageHDU 9 (424, 11) float32 9 ASDF 1 BinTableHDU 11 1R x 1C [151383B]
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/gwcs/geometry.py:203: RuntimeWarning: invalid value encountered in remainder lon = np.mod(lon, 360.0 * u.deg if nquant else 360.0)
flat_field_file --> Grating:PRISM Filter:CLEAR LAMP:LINE4
Using D-flat: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_dflat_nrs1_f_01.03.fits
Using S-flat: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_MOS_sflat_PRISM_OPAQUE_FLAT5_nrs1_f_01.01.fits
Using F-flat: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_MOS_fflat_CLEAR_01.01.fits
Working with slit: 3
Subwindow origin: px0=1028 py0=1972
silt_id='3' quad=3 row=185 col=13 slitlet_id='185_13'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = -1.162e-03 median = 2.571e-05 stdev = 2.242e-02
Maximum AbsoluteFlat Difference = 9.550e-02
Minimum AbsoluteFlat Difference = -9.974e-02
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 99%
-> 3xtheshold = 97%
-> 5xtheshold = 95%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
*** WARNING: More than 10% of pixels have a median value greater than 5xthreshold!
Making histogram plot for this slitlet...
*** Result of the test: PASSED Working with slit: 4 Subwindow origin: px0=1276 py0=33 silt_id='4' quad=4 row=190 col=158 slitlet_id='190_158' Now looping through the pixels, this will take a while ...
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/nirspec_pipe_testing_tool/calwebb_spec2_pytests/auxiliary_code/flattest_mos.py:527: RuntimeWarning: invalid value encountered in true_divide sff = int_tab/(last_sfv_wav - first_sfv_wav)
Calculating statistics...
Absolute Flat Difference : mean = -4.388e-04 median = 3.082e-05 stdev = 2.477e-02
Maximum AbsoluteFlat Difference = 9.768e-02
Minimum AbsoluteFlat Difference = -9.941e-02
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 99%
-> 3xtheshold = 97%
-> 5xtheshold = 95%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
*** WARNING: More than 10% of pixels have a median value greater than 5xthreshold!
Making histogram plot for this slitlet...
*** Result of the test: PASSED
*** Final result for flat_field test will be reported as PASSED ***
('* Script flattest_mos.py took ', '28.292841911315918 seconds to finish.')
Did flat_field validation test passed? All slitlets PASSED flat_field test.
Closing file: popenfile(path='/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_dflat_nrs1_f_01.03.fits', fd=49, position=680480640, mode='r', flags=557056)
Closing file: popenfile(path='/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_MOS_sflat_PRISM_OPAQUE_FLAT5_nrs1_f_01.01.fits', fd=58, position=1258421760, mode='r', flags=557056)
Closing file: popenfile(path='/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_MOS_fflat_CLEAR_01.01.fits', fd=59, position=299989440, mode='r', flags=557056)
Closing file: popenfile(path='/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/V0030006000104_msa.fits', fd=60, position=512640, mode='r', flags=557056)
Closing file: popenfile(path='/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/mos_prism_nrs1_interpolatedflat.fits', fd=61, position=149760, mode='r', flags=557056)
Testing files for detector: nrs2
Working with uncal_file: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/mos_prism_nrs2_uncal.fits
2021-04-23 15:48:50,554 - stpipe - INFO - PARS-DETECTOR1PIPELINE parameters found: /grp/crds/cache/references/jwst/jwst_nirspec_pars-detector1pipeline_0004.asdf
2021-04-23 15:48:50,571 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2021-04-23 15:48:50,572 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2021-04-23 15:48:50,573 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2021-04-23 15:48:50,574 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2021-04-23 15:48:50,575 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2021-04-23 15:48:50,576 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2021-04-23 15:48:50,578 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2021-04-23 15:48:50,579 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2021-04-23 15:48:50,580 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2021-04-23 15:48:50,581 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2021-04-23 15:48:50,582 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2021-04-23 15:48:50,583 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2021-04-23 15:48:50,584 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2021-04-23 15:48:50,586 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2021-04-23 15:48:50,587 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2021-04-23 15:48:50,588 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2021-04-23 15:48:50,589 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/stpipe/step.py:359: ResourceWarning: unclosed file <_io.FileIO name='/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/mos_prism_nrs2_uncal.fits' mode='rb' closefd=True>
gc.collect()
2021-04-23 15:48:50,796 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/mos_prism_nrs2_uncal.fits',).
2021-04-23 15:48:50,806 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 4.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 200.0, 'min_jump_to_flag_neighbors': 10.0}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2021-04-23 15:48:50,894 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'mos_prism_nrs2_uncal.fits' reftypes = ['dark', 'gain', 'linearity', 'mask', 'persat', 'readnoise', 'refpix', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2021-04-23 15:48:50,902 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_dark_0087.fits'.
2021-04-23 15:48:50,904 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_gain_0018.fits'.
2021-04-23 15:48:50,906 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_linearity_0021.fits'.
2021-04-23 15:48:50,908 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_mask_0011.fits'.
2021-04-23 15:48:50,910 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2021-04-23 15:48:50,910 - stpipe.Detector1Pipeline - INFO - Prefetch for READNOISE reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0017.fits'.
2021-04-23 15:48:50,913 - stpipe.Detector1Pipeline - INFO - Prefetch for REFPIX reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_refpix_0020.fits'.
2021-04-23 15:48:50,915 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is 'N/A'.
2021-04-23 15:48:50,915 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is 'N/A'.
2021-04-23 15:48:50,915 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_saturation_0021.fits'.
2021-04-23 15:48:50,917 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_superbias_0114.fits'.
2021-04-23 15:48:50,920 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2021-04-23 15:48:50,920 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2021-04-23 15:48:50,920 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2021-04-23 15:48:51,239 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs2_uncal.fits>,).
2021-04-23 15:48:51,241 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:48:51,408 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES and FRMDIVSR are equal; correction not needed
2021-04-23 15:48:51,408 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2021-04-23 15:48:51,409 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2021-04-23 15:48:51,525 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs2_uncal.fits>,).
2021-04-23 15:48:51,526 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:48:51,543 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_nirspec_mask_0011.fits
2021-04-23 15:48:51,907 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2021-04-23 15:48:52,097 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs2_uncal.fits>,).
2021-04-23 15:48:52,098 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:48:52,115 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_nirspec_saturation_0021.fits
2021-04-23 15:48:52,528 - stpipe.Detector1Pipeline.saturation - INFO - Detected 5379 saturated pixels
2021-04-23 15:48:52,551 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2021-04-23 15:48:52,572 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2021-04-23 15:48:52,790 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs2_uncal.fits>,).
2021-04-23 15:48:52,792 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:48:52,792 - stpipe.Detector1Pipeline.ipc - INFO - Step skipped.
2021-04-23 15:48:52,793 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2021-04-23 15:48:52,976 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs2_uncal.fits>,).
2021-04-23 15:48:52,977 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:48:52,994 - stpipe.Detector1Pipeline.superbias - INFO - Using SUPERBIAS reference file /grp/crds/cache/references/jwst/jwst_nirspec_superbias_0114.fits
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/stdatamodels/validate.py:34: ValidationWarning: While validating meta.exposure.readpatt the following error occurred:
'ALLIRS2' is not one of ['ACQ1', 'ACQ2', 'BRIGHT1', 'BRIGHT2', 'DEEP2', 'DEEP8', 'FAST', 'FASTGRPAVG', 'FASTGRPAVG8', 'FASTGRPAVG16', 'FASTGRPAVG32', 'FASTGRPAVG64', 'FASTR1', 'FASTR100', 'FGS', 'FGS60', 'FGS8370', 'FGS840', 'FGSRAPID', 'FINEGUIDE', 'ID', 'MEDIUM2', 'MEDIUM8', 'NIS', 'NISRAPID', 'NRS', 'NRSIRS2', 'NRSN16R4', 'NRSN32R8', 'NRSN8R2', 'NRSRAPID', 'NRSIRS2RAPID', 'NRSRAPIDD1', 'NRSRAPIDD2', 'NRSRAPIDD6', 'NRSSLOW', 'RAPID', 'SHALLOW2', 'SHALLOW4', 'SLOW', 'SLOWR1', 'TRACK', 'ANY', 'N/A']
Failed validating 'enum' in schema:
OrderedDict([('title', 'Readout pattern'),
('type', 'string'),
('enum',
['ACQ1',
'ACQ2',
'BRIGHT1',
'BRIGHT2',
'DEEP2',
'DEEP8',
'FAST',
'FASTGRPAVG',
'FASTGRPAVG8',
'FASTGRPAVG16',
'FASTGRPAVG32',
'FASTGRPAVG64',
'FASTR1',
'FASTR100',
'FGS',
'FGS60',
'FGS8370',
'FGS840',
'FGSRAPID',
'FINEGUIDE',
'ID',
'MEDIUM2',
'MEDIUM8',
'NIS',
'NISRAPID',
'NRS',
'NRSIRS2',
'NRSN16R4',
'NRSN32R8',
'NRSN8R2',
'NRSRAPID',
'NRSIRS2RAPID',
'NRSRAPIDD1',
'NRSRAPIDD2',
'NRSRAPIDD6',
'NRSSLOW',
'RAPID',
'SHALLOW2',
'SHALLOW4',
'SLOW',
'SLOWR1',
'TRACK',
'ANY',
'N/A']),
('fits_ke ...
warnings.warn(errmsg, ValidationWarning)
2021-04-23 15:48:53,270 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias done
2021-04-23 15:48:53,461 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs2_uncal.fits>,).
2021-04-23 15:48:53,462 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2021-04-23 15:48:53,479 - stpipe.Detector1Pipeline.refpix - INFO - Using refpix reference file: /grp/crds/cache/references/jwst/jwst_nirspec_refpix_0020.fits
2021-04-23 15:49:07,395 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2021-04-23 15:49:07,731 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs2_uncal.fits>,).
2021-04-23 15:49:07,732 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:49:07,751 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_nirspec_linearity_0021.fits
2021-04-23 15:49:08,308 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2021-04-23 15:49:08,431 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs2_uncal.fits>,).
2021-04-23 15:49:08,432 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4', 'dark_output': None}
2021-04-23 15:49:08,448 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_nirspec_dark_0087.fits
2021-04-23 15:49:12,210 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=1, ngroups=4, nframes=1, groupgap=0
2021-04-23 15:49:12,211 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=1, ngroups=65, nframes=1, groupgap=0
2021-04-23 15:49:12,556 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2021-04-23 15:49:13,250 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs2_uncal.fits>,).
2021-04-23 15:49:13,252 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4', 'rejection_threshold': 4.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 200.0, 'min_jump_to_flag_neighbors': 10.0}
2021-04-23 15:49:13,261 - stpipe.Detector1Pipeline.jump - WARNING - Can not apply jump detection when NGROUPS<=4;
2021-04-23 15:49:13,262 - stpipe.Detector1Pipeline.jump - WARNING - Jump step will be skipped
2021-04-23 15:49:13,334 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2021-04-23 15:49:13,454 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs2_uncal.fits>,).
2021-04-23 15:49:13,456 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}
2021-04-23 15:49:13,481 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0017.fits
2021-04-23 15:49:13,511 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0018.fits
2021-04-23 15:49:13,546 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2021-04-23 15:49:13,546 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
2021-04-23 15:49:24,254 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 4
2021-04-23 15:49:24,256 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 1
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/jwst/ramp_fitting/ramp_fit.py:1091: RuntimeWarning: divide by zero encountered in true_divide
var_p2 = 1/(s_inv_var_p3.sum(axis=0))
2021-04-23 15:49:24,369 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2021-04-23 15:49:24,511 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<ImageModel(2048, 2048) from mos_prism_nrs2_uncal.fits>,).
2021-04-23 15:49:24,512 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:49:24,560 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2021-04-23 15:49:24,561 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2021-04-23 15:49:24,562 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2021-04-23 15:49:24,670 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(1, 2048, 2048) from mos_prism_nrs2_uncal.fits>,).
2021-04-23 15:49:24,672 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:49:24,715 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2021-04-23 15:49:24,715 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2021-04-23 15:49:24,717 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2021-04-23 15:49:24,717 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2021-04-23 15:49:24,718 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2021-04-23 15:49:24,727 - stpipe.AssignWcsStep - INFO - AssignWcsStep instance created.
2021-04-23 15:49:24,838 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep running with args (<ImageModel(2048, 2048) from mos_prism_nrs2_uncal.fits>,).
2021-04-23 15:49:24,839 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2021-04-23 15:49:24,983 - stpipe.AssignWcsStep - INFO - Retrieving open MSA slitlets for msa_metadata_id = 1 and dither_index = 1
2021-04-23 15:49:25,000 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.0332140289247036 deg
2021-04-23 15:49:25,000 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3367482721805573 deg
2021-04-23 15:49:25,001 - stpipe.AssignWcsStep - INFO - theta_y correction: -1.0907214098475986e-05 deg
2021-04-23 15:49:25,002 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2021-04-23 15:49:25,173 - stpipe.AssignWcsStep - INFO - Removing slit 3 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:49:25,247 - stpipe.AssignWcsStep - INFO - Removing slit 4 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:49:25,249 - stpipe.AssignWcsStep - INFO - Slits projected on detector NRS2: []
2021-04-23 15:49:25,250 - stpipe.AssignWcsStep - CRITICAL - No open slits fall on detector NRS2.
No open slits fall on detector nrs2 Skipping test for this file. Did flat_field validation test passed? skipped Testing files for detector: nrs1 Working with uncal_file: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/mos_g140m_line1_NRS1_uncal.fits
2021-04-23 15:49:38,371 - stpipe - INFO - PARS-DETECTOR1PIPELINE parameters found: /grp/crds/cache/references/jwst/jwst_nirspec_pars-detector1pipeline_0004.asdf
2021-04-23 15:49:38,385 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2021-04-23 15:49:38,385 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2021-04-23 15:49:38,387 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2021-04-23 15:49:38,387 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2021-04-23 15:49:38,388 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2021-04-23 15:49:38,389 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2021-04-23 15:49:38,390 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2021-04-23 15:49:38,391 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2021-04-23 15:49:38,392 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2021-04-23 15:49:38,393 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2021-04-23 15:49:38,394 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2021-04-23 15:49:38,395 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2021-04-23 15:49:38,396 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2021-04-23 15:49:38,397 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2021-04-23 15:49:38,398 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2021-04-23 15:49:38,399 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2021-04-23 15:49:38,400 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/stpipe/step.py:359: ResourceWarning: unclosed file <_io.FileIO name='/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/mos_g140m_line1_NRS1_uncal.fits' mode='rb' closefd=True>
gc.collect()
2021-04-23 15:49:38,521 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/mos_g140m_line1_NRS1_uncal.fits',).
2021-04-23 15:49:38,530 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 4.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 200.0, 'min_jump_to_flag_neighbors': 10.0}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2021-04-23 15:49:38,623 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'mos_g140m_line1_NRS1_uncal.fits' reftypes = ['dark', 'gain', 'linearity', 'mask', 'persat', 'readnoise', 'refpix', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2021-04-23 15:49:38,630 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_dark_0140.fits'.
2021-04-23 15:49:38,632 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_gain_0019.fits'.
2021-04-23 15:49:38,633 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_linearity_0019.fits'.
2021-04-23 15:49:38,635 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_mask_0024.fits'.
2021-04-23 15:49:38,637 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2021-04-23 15:49:38,637 - stpipe.Detector1Pipeline - INFO - Prefetch for READNOISE reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0019.fits'.
2021-04-23 15:49:38,639 - stpipe.Detector1Pipeline - INFO - Prefetch for REFPIX reference file is 'N/A'.
2021-04-23 15:49:38,639 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is 'N/A'.
2021-04-23 15:49:38,639 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is 'N/A'.
2021-04-23 15:49:38,640 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_saturation_0023.fits'.
2021-04-23 15:49:38,641 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_superbias_0087.fits'.
2021-04-23 15:49:38,642 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2021-04-23 15:49:38,642 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2021-04-23 15:49:38,643 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2021-04-23 15:49:38,878 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS1_uncal.fits>,).
2021-04-23 15:49:38,879 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:49:38,962 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES and FRMDIVSR are equal; correction not needed
2021-04-23 15:49:38,963 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2021-04-23 15:49:38,964 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2021-04-23 15:49:39,070 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS1_uncal.fits>,).
2021-04-23 15:49:39,072 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:49:39,087 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_nirspec_mask_0024.fits
2021-04-23 15:49:39,272 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2021-04-23 15:49:39,381 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS1_uncal.fits>,).
2021-04-23 15:49:39,383 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:49:39,398 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_nirspec_saturation_0023.fits
2021-04-23 15:49:39,717 - stpipe.Detector1Pipeline.saturation - INFO - Detected 58922 saturated pixels
2021-04-23 15:49:39,736 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2021-04-23 15:49:39,744 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2021-04-23 15:49:39,853 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS1_uncal.fits>,).
2021-04-23 15:49:39,854 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:49:39,854 - stpipe.Detector1Pipeline.ipc - INFO - Step skipped.
2021-04-23 15:49:39,855 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2021-04-23 15:49:39,954 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS1_uncal.fits>,).
2021-04-23 15:49:39,955 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:49:39,971 - stpipe.Detector1Pipeline.superbias - INFO - Using SUPERBIAS reference file /grp/crds/cache/references/jwst/jwst_nirspec_superbias_0087.fits
2021-04-23 15:49:40,180 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias done
2021-04-23 15:49:40,295 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS1_uncal.fits>,).
2021-04-23 15:49:40,296 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2021-04-23 15:49:40,303 - stpipe.Detector1Pipeline.refpix - INFO - use_side_ref_pixels = True
2021-04-23 15:49:40,303 - stpipe.Detector1Pipeline.refpix - INFO - odd_even_columns = True
2021-04-23 15:49:40,304 - stpipe.Detector1Pipeline.refpix - INFO - side_smoothing_length = 11
2021-04-23 15:49:40,304 - stpipe.Detector1Pipeline.refpix - INFO - side_gain = 1.000000
2021-04-23 15:49:40,304 - stpipe.Detector1Pipeline.refpix - INFO - odd_even_rows = True
2021-04-23 15:49:42,822 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2021-04-23 15:49:42,949 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS1_uncal.fits>,).
2021-04-23 15:49:42,950 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:49:42,966 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_nirspec_linearity_0019.fits
2021-04-23 15:49:43,571 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2021-04-23 15:49:43,687 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS1_uncal.fits>,).
2021-04-23 15:49:43,688 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4', 'dark_output': None}
2021-04-23 15:49:43,705 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_nirspec_dark_0140.fits
2021-04-23 15:49:43,886 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=1, ngroups=6, nframes=1, groupgap=0
2021-04-23 15:49:43,886 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=1, ngroups=10, nframes=1, groupgap=0
2021-04-23 15:49:44,110 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2021-04-23 15:49:44,219 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS1_uncal.fits>,).
2021-04-23 15:49:44,221 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4', 'rejection_threshold': 4.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 200.0, 'min_jump_to_flag_neighbors': 10.0}
2021-04-23 15:49:44,227 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 4 sigma
2021-04-23 15:49:44,237 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0019.fits
2021-04-23 15:49:44,274 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0019.fits
2021-04-23 15:49:44,306 - stpipe.Detector1Pipeline.jump - INFO - Found 32 possible cores to use for jump detection
2021-04-23 15:49:44,458 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2021-04-23 15:49:44,698 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
2021-04-23 15:49:45,976 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 64057 pixels with at least one CR
2021-04-23 15:49:48,213 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 3.75465 sec
2021-04-23 15:49:48,216 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 3.988172
2021-04-23 15:49:48,217 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2021-04-23 15:49:48,349 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS1_uncal.fits>,).
2021-04-23 15:49:48,351 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}
2021-04-23 15:49:48,375 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0019.fits
2021-04-23 15:49:48,409 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0019.fits
2021-04-23 15:49:48,440 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2021-04-23 15:49:48,441 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/jwst/ramp_fitting/ramp_fit.py:872: RuntimeWarning: invalid value encountered in multiply
var_p4[num_int,:,:,:] *= ( segs_4[num_int,:,:,:] > 0)
2021-04-23 15:50:12,572 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 6
2021-04-23 15:50:12,573 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 1
2021-04-23 15:50:12,673 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2021-04-23 15:50:12,786 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<ImageModel(2048, 2048) from mos_g140m_line1_NRS1_uncal.fits>,).
2021-04-23 15:50:12,788 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:50:12,836 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2021-04-23 15:50:12,837 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2021-04-23 15:50:12,838 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2021-04-23 15:50:12,945 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(1, 2048, 2048) from mos_g140m_line1_NRS1_uncal.fits>,).
2021-04-23 15:50:12,947 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:50:12,993 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2021-04-23 15:50:12,994 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2021-04-23 15:50:12,995 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2021-04-23 15:50:12,995 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2021-04-23 15:50:12,996 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2021-04-23 15:50:13,005 - stpipe.AssignWcsStep - INFO - AssignWcsStep instance created.
2021-04-23 15:50:13,119 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep running with args (<ImageModel(2048, 2048) from mos_g140m_line1_NRS1_uncal.fits>,).
2021-04-23 15:50:13,120 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2021-04-23 15:50:13,262 - stpipe.AssignWcsStep - INFO - Retrieving open MSA slitlets for msa_metadata_id = 1 and dither_index = 1
2021-04-23 15:50:13,465 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.1260581910610199 deg
2021-04-23 15:50:13,465 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3316612243652344 deg
2021-04-23 15:50:13,466 - stpipe.AssignWcsStep - INFO - theta_y correction: 0.0002496099796717191 deg
2021-04-23 15:50:13,467 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2021-04-23 15:50:13,579 - stpipe.AssignWcsStep - INFO - Removing slit 6 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:50:13,591 - stpipe.AssignWcsStep - INFO - Removing slit 7 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:50:13,604 - stpipe.AssignWcsStep - INFO - Removing slit 8 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:50:13,616 - stpipe.AssignWcsStep - INFO - Removing slit 9 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:50:13,628 - stpipe.AssignWcsStep - INFO - Removing slit 10 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:50:13,640 - stpipe.AssignWcsStep - INFO - Removing slit 11 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:50:13,652 - stpipe.AssignWcsStep - INFO - Removing slit 14 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:50:13,665 - stpipe.AssignWcsStep - INFO - Removing slit 15 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:50:13,677 - stpipe.AssignWcsStep - INFO - Removing slit 16 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:50:13,689 - stpipe.AssignWcsStep - INFO - Removing slit 17 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:50:13,702 - stpipe.AssignWcsStep - INFO - Removing slit 18 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:50:13,714 - stpipe.AssignWcsStep - INFO - Removing slit 19 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:50:13,726 - stpipe.AssignWcsStep - INFO - Removing slit 21 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:50:13,739 - stpipe.AssignWcsStep - INFO - Removing slit 25 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:50:13,751 - stpipe.AssignWcsStep - INFO - Removing slit 26 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:50:13,763 - stpipe.AssignWcsStep - INFO - Removing slit 27 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:50:13,775 - stpipe.AssignWcsStep - INFO - Removing slit 29 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:50:13,788 - stpipe.AssignWcsStep - INFO - Removing slit 31 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:50:13,800 - stpipe.AssignWcsStep - INFO - Removing slit 32 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:50:13,812 - stpipe.AssignWcsStep - INFO - Removing slit 33 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:50:13,825 - stpipe.AssignWcsStep - INFO - Removing slit 35 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:50:13,837 - stpipe.AssignWcsStep - INFO - Removing slit 37 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:50:13,849 - stpipe.AssignWcsStep - INFO - Removing slit 38 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:50:13,861 - stpipe.AssignWcsStep - INFO - Removing slit 39 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:50:13,875 - stpipe.AssignWcsStep - INFO - Removing slit 41 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:50:13,910 - stpipe.AssignWcsStep - INFO - Removing slit 1 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:50:13,923 - stpipe.AssignWcsStep - INFO - Removing slit 2 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:50:13,935 - stpipe.AssignWcsStep - INFO - Removing slit 3 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:50:13,947 - stpipe.AssignWcsStep - INFO - Removing slit 4 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:50:13,959 - stpipe.AssignWcsStep - INFO - Removing slit 5 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:50:13,972 - stpipe.AssignWcsStep - INFO - Removing slit 12 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:50:13,984 - stpipe.AssignWcsStep - INFO - Removing slit 13 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:50:13,996 - stpipe.AssignWcsStep - INFO - Removing slit 20 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:50:14,008 - stpipe.AssignWcsStep - INFO - Removing slit 22 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:50:14,020 - stpipe.AssignWcsStep - INFO - Removing slit 23 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:50:14,032 - stpipe.AssignWcsStep - INFO - Removing slit 24 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:50:14,045 - stpipe.AssignWcsStep - INFO - Removing slit 28 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:50:14,058 - stpipe.AssignWcsStep - INFO - Removing slit 30 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:50:14,070 - stpipe.AssignWcsStep - INFO - Removing slit 34 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:50:14,083 - stpipe.AssignWcsStep - INFO - Removing slit 36 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:50:14,095 - stpipe.AssignWcsStep - INFO - Removing slit 40 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:50:14,387 - stpipe.AssignWcsStep - INFO - Slits projected on detector NRS1: [42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68]
2021-04-23 15:50:14,388 - stpipe.AssignWcsStep - INFO - Computing WCS for 27 open slitlets
2021-04-23 15:50:14,401 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.1260581910610199 deg
2021-04-23 15:50:14,401 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3316612243652344 deg
2021-04-23 15:50:14,402 - stpipe.AssignWcsStep - INFO - theta_y correction: 0.0002496099796717191 deg
2021-04-23 15:50:14,402 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2021-04-23 15:50:14,409 - stpipe.AssignWcsStep - INFO - SPORDER= -1, wrange=[9.7e-07, 1.89e-06]
2021-04-23 15:50:14,497 - stpipe.AssignWcsStep - INFO - There are 2 open slits in quadrant 1
2021-04-23 15:50:14,514 - stpipe.AssignWcsStep - INFO - There are 11 open slits in quadrant 2
2021-04-23 15:50:14,603 - stpipe.AssignWcsStep - INFO - There are 4 open slits in quadrant 3
2021-04-23 15:50:14,635 - stpipe.AssignWcsStep - INFO - There are 10 open slits in quadrant 4
2021-04-23 15:50:14,713 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 5
2021-04-23 15:50:14,995 - stpipe.AssignWcsStep - INFO - Created a NIRSPEC nrs_msaspec pipeline with references {'distortion': None, 'filteroffset': None, 'specwcs': None, 'regions': None, 'wavelengthrange': '/grp/crds/cache/references/jwst/jwst_nirspec_wavelengthrange_0004.asdf', 'camera': '/grp/crds/cache/references/jwst/jwst_nirspec_camera_0004.asdf', 'collimator': '/grp/crds/cache/references/jwst/jwst_nirspec_collimator_0004.asdf', 'disperser': '/grp/crds/cache/references/jwst/jwst_nirspec_disperser_0032.asdf', 'fore': '/grp/crds/cache/references/jwst/jwst_nirspec_fore_0023.asdf', 'fpa': '/grp/crds/cache/references/jwst/jwst_nirspec_fpa_0005.asdf', 'msa': '/grp/crds/cache/references/jwst/jwst_nirspec_msa_0005.asdf', 'ote': '/grp/crds/cache/references/jwst/jwst_nirspec_ote_0005.asdf', 'ifupost': None, 'ifufore': None, 'ifuslicer': None, 'msametafile': 'V8460001000101_msa.fits'}
2021-04-23 15:50:15,376 - stpipe.AssignWcsStep - INFO - COMPLETED assign_wcs
2021-04-23 15:50:15,379 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep done
2021-04-23 15:50:15,387 - stpipe.MSAFlagOpenStep - INFO - MSAFlagOpenStep instance created.
2021-04-23 15:50:15,536 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep running with args (<ImageModel(2048, 2048) from mos_g140m_line1_NRS1_uncal.fits>,).
2021-04-23 15:50:15,537 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-04-23 15:50:15,551 - stpipe.MSAFlagOpenStep - INFO - Using reference file /grp/crds/cache/references/jwst/jwst_nirspec_msaoper_0001.json
2021-04-23 15:50:15,552 - stpipe.JwstStep - INFO - JwstStep instance created.
2021-04-23 15:50:15,653 - stpipe.MSAFlagOpenStep - INFO - gwa_ytilt is 0.1260581910610199 deg
2021-04-23 15:50:15,654 - stpipe.MSAFlagOpenStep - INFO - gwa_xtilt is 0.3316612243652344 deg
2021-04-23 15:50:15,654 - stpipe.MSAFlagOpenStep - INFO - theta_y correction: 0.0002496099796717191 deg
2021-04-23 15:50:15,655 - stpipe.MSAFlagOpenStep - INFO - theta_x correction: 0.0 deg
2021-04-23 15:50:15,662 - stpipe.MSAFlagOpenStep - INFO - SPORDER= -1, wrange=[9.7e-07, 1.89e-06]
2021-04-23 15:50:15,751 - stpipe.MSAFlagOpenStep - INFO - There are 5 open slits in quadrant 1
2021-04-23 15:50:15,792 - stpipe.MSAFlagOpenStep - INFO - There are 3 open slits in quadrant 2
2021-04-23 15:50:15,816 - stpipe.MSAFlagOpenStep - INFO - There are 9 open slits in quadrant 3
2021-04-23 15:50:15,887 - stpipe.MSAFlagOpenStep - INFO - There are 3 open slits in quadrant 4
2021-04-23 15:50:15,911 - stpipe.MSAFlagOpenStep - INFO - There are 0 open slits in quadrant 5
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/gwcs/geometry.py:203: RuntimeWarning: invalid value encountered in remainder
lon = np.mod(lon, 360.0 * u.deg if nquant else 360.0)
2021-04-23 15:50:26,801 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep done
2021-04-23 15:50:26,812 - stpipe.Extract2dStep - INFO - Extract2dStep instance created.
2021-04-23 15:50:27,069 - stpipe.Extract2dStep - INFO - Step Extract2dStep running with args (<ImageModel(2048, 2048) from mos_g140m_line1_NRS1_uncal.fits>,).
2021-04-23 15:50:27,071 - stpipe.Extract2dStep - INFO - Step Extract2dStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'slit_name': None, 'extract_orders': None, 'tsgrism_extract_height': None, 'wfss_extract_half_height': 5, 'grism_objects': None, 'mmag_extract': 99.0}
2021-04-23 15:50:27,086 - stpipe.Extract2dStep - INFO - EXP_TYPE is NRS_MSASPEC
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/gwcs/utils.py:72: DeprecationWarning: `np.int` is a deprecated alias for the builtin `int`. To silence this warning, use `int` by itself. Doing this will not modify any behavior and is safe. When replacing `np.int`, you may wish to use e.g. `np.int64` or `np.int32` to specify the precision. If you wish to review your current use, check the release note link for additional information.
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
indx = np.asarray(np.floor(np.asarray(value) + 0.5), dtype=np.int)
2021-04-23 15:50:27,519 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 53
2021-04-23 15:50:27,520 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 1542 2048
2021-04-23 15:50:27,521 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1315 1329
2021-04-23 15:50:27,619 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:50:27,626 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.226123221 -45.673642180 156.225994086 -45.673519691 156.225931834 -45.673551545 156.226060967 -45.673674035
2021-04-23 15:50:27,627 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.226123221 -45.673642180 156.225994086 -45.673519691 156.225931834 -45.673551545 156.226060967 -45.673674035
2021-04-23 15:50:28,207 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 54
2021-04-23 15:50:28,208 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 1542 2048
2021-04-23 15:50:28,208 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1305 1319
2021-04-23 15:50:28,305 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:50:28,312 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.225872406 -45.673404272 156.225743296 -45.673281804 156.225681049 -45.673313656 156.225810156 -45.673436124
2021-04-23 15:50:28,313 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.225872406 -45.673404272 156.225743296 -45.673281804 156.225681049 -45.673313656 156.225810156 -45.673436124
2021-04-23 15:50:28,922 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 42
2021-04-23 15:50:28,923 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 2018 2048
2021-04-23 15:50:28,923 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 545 562
2021-04-23 15:50:29,017 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:50:29,024 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.223646010 -45.647128995 156.223518121 -45.647008321 156.223456024 -45.647039957 156.223583911 -45.647160632
2021-04-23 15:50:29,024 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.223646010 -45.647128995 156.223518121 -45.647008321 156.223456024 -45.647039957 156.223583911 -45.647160632
2021-04-23 15:50:29,633 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 43
2021-04-23 15:50:29,633 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 1970 2048
2021-04-23 15:50:29,634 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 414 430
2021-04-23 15:50:29,728 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:50:29,735 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.218966486 -45.644829601 156.218838959 -45.644709141 156.218776943 -45.644740759 156.218904467 -45.644861220
2021-04-23 15:50:29,735 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.218966486 -45.644829601 156.218838959 -45.644709141 156.218776943 -45.644740759 156.218904467 -45.644861220
2021-04-23 15:50:30,159 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 44
2021-04-23 15:50:30,160 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 1969 2048
2021-04-23 15:50:30,160 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 404 420
2021-04-23 15:50:30,254 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:50:30,261 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.218718991 -45.644595818 156.218591488 -45.644475376 156.218529475 -45.644506992 156.218656977 -45.644627436
2021-04-23 15:50:30,262 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.218718991 -45.644595818 156.218591488 -45.644475376 156.218529475 -45.644506992 156.218656977 -45.644627436
2021-04-23 15:50:30,884 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 45
2021-04-23 15:50:30,885 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 1908 2048
2021-04-23 15:50:30,885 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 530 546
2021-04-23 15:50:30,980 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:50:30,988 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.219673020 -45.648613077 156.219545303 -45.648492383 156.219483265 -45.648524021 156.219610979 -45.648644716
2021-04-23 15:50:30,989 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.219673020 -45.648613077 156.219545303 -45.648492383 156.219483265 -45.648524021 156.219610979 -45.648644716
2021-04-23 15:50:31,603 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 46
2021-04-23 15:50:31,604 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 1882 2048
2021-04-23 15:50:31,604 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 202 218
2021-04-23 15:50:31,699 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:50:31,707 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.211127421 -45.641279813 156.211000463 -45.641159678 156.210938572 -45.641191268 156.211065527 -45.641311404
2021-04-23 15:50:31,707 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.211127421 -45.641279813 156.211000463 -45.641159678 156.210938572 -45.641191268 156.211065527 -45.641311404
2021-04-23 15:50:32,133 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 47
2021-04-23 15:50:32,133 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 1815 2048
2021-04-23 15:50:32,134 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 566 581
2021-04-23 15:50:32,245 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:50:32,253 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.217456055 -45.651006881 156.217328370 -45.650886079 156.217266356 -45.650917729 156.217394038 -45.651038531
2021-04-23 15:50:32,253 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.217456055 -45.651006881 156.217328370 -45.650886079 156.217266356 -45.650917729 156.217394038 -45.651038531
2021-04-23 15:50:32,886 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 48
2021-04-23 15:50:32,887 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 1815 2048
2021-04-23 15:50:32,887 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 561 576
2021-04-23 15:50:32,983 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:50:32,990 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.217332149 -45.650889654 156.217204477 -45.650768862 156.217142464 -45.650800511 156.217270135 -45.650921304
2021-04-23 15:50:32,990 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.217332149 -45.650889654 156.217204477 -45.650768862 156.217142464 -45.650800511 156.217270135 -45.650921304
2021-04-23 15:50:33,614 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 49
2021-04-23 15:50:33,614 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 1791 2048
2021-04-23 15:50:33,615 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 631 646
2021-04-23 15:50:33,711 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:50:33,718 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.218210913 -45.652969013 156.218083107 -45.652848076 156.218021073 -45.652879740 156.218148877 -45.653000678
2021-04-23 15:50:33,719 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.218210913 -45.652969013 156.218083107 -45.652848076 156.218021073 -45.652879740 156.218148877 -45.653000678
2021-04-23 15:50:34,144 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 50
2021-04-23 15:50:34,145 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 1774 2048
2021-04-23 15:50:34,145 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 238 253
2021-04-23 15:50:34,241 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:50:34,248 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.208399869 -45.643929179 156.208272959 -45.643808942 156.208211096 -45.643840541 156.208338005 -45.643960778
2021-04-23 15:50:34,249 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.208399869 -45.643929179 156.208272959 -45.643808942 156.208211096 -45.643840541 156.208338005 -45.643960778
2021-04-23 15:50:34,895 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 51
2021-04-23 15:50:34,896 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 1759 2048
2021-04-23 15:50:34,896 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 430 445
2021-04-23 15:50:34,993 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:50:35,001 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.212403238 -45.648718689 156.212275928 -45.648598111 156.212213993 -45.648629742 156.212341301 -45.648750320
2021-04-23 15:50:35,001 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.212403238 -45.648718689 156.212275928 -45.648598111 156.212213993 -45.648629742 156.212341301 -45.648750320
2021-04-23 15:50:35,636 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 52
2021-04-23 15:50:35,636 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 1722 2048
2021-04-23 15:50:35,637 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 803 817
2021-04-23 15:50:35,735 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:50:35,742 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.219947139 -45.658234585 156.219819020 -45.658113276 156.219756938 -45.658144979 156.219885055 -45.658266289
2021-04-23 15:50:35,743 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.219947139 -45.658234585 156.219819020 -45.658113276 156.219756938 -45.658144979 156.219885055 -45.658266289
2021-04-23 15:50:36,169 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 55
2021-04-23 15:50:36,170 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 1022 2048
2021-04-23 15:50:36,170 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1415 1430
2021-04-23 15:50:36,273 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:50:36,280 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.211226719 -45.684941334 156.211098073 -45.684818233 156.211035880 -45.684850241 156.211164524 -45.684973343
2021-04-23 15:50:36,281 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.211226719 -45.684941334 156.211098073 -45.684818233 156.211035880 -45.684850241 156.211164524 -45.684973343
2021-04-23 15:50:36,940 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 65
2021-04-23 15:50:36,941 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 427 1893
2021-04-23 15:50:36,941 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1251 1273
2021-04-23 15:50:37,056 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:50:37,063 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.187669449 -45.691221095 156.187541886 -45.691097893 156.187479754 -45.691130071 156.187607315 -45.691253274
2021-04-23 15:50:37,064 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.187669449 -45.691221095 156.187541886 -45.691097893 156.187479754 -45.691130071 156.187607315 -45.691253274
2021-04-23 15:50:37,483 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 66
2021-04-23 15:50:37,484 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 426 1892
2021-04-23 15:50:37,484 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1452 1474
2021-04-23 15:50:37,601 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:50:37,609 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.192290190 -45.696194513 156.192162195 -45.696070854 156.192099979 -45.696103094 156.192227972 -45.696226755
2021-04-23 15:50:37,610 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.192290190 -45.696194513 156.192162195 -45.696070854 156.192099979 -45.696103094 156.192227972 -45.696226755
2021-04-23 15:50:38,273 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 68
2021-04-23 15:50:38,274 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 375 1842
2021-04-23 15:50:38,274 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1476 1499
2021-04-23 15:50:38,391 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:50:38,399 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.191192483 -45.697686513 156.191064493 -45.697562756 156.191002259 -45.697595026 156.191130247 -45.697718784
2021-04-23 15:50:38,399 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.191192483 -45.697686513 156.191064493 -45.697562756 156.191002259 -45.697595026 156.191130247 -45.697718784
2021-04-23 15:50:39,052 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 56
2021-04-23 15:50:39,053 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 872 2048
2021-04-23 15:50:39,053 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 768 783
2021-04-23 15:50:39,156 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:50:39,163 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.191122501 -45.671742959 156.190995485 -45.671621176 156.190933579 -45.671653049 156.191060593 -45.671774833
2021-04-23 15:50:39,164 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.191122501 -45.671742959 156.190995485 -45.671621176 156.190933579 -45.671653049 156.191060593 -45.671774833
2021-04-23 15:50:39,590 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 57
2021-04-23 15:50:39,591 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 805 2048
2021-04-23 15:50:39,591 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 354 370
2021-04-23 15:50:39,696 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:50:39,703 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.179343124 -45.662963603 156.179216994 -45.662842617 156.179155236 -45.662874401 156.179281365 -45.662995389
2021-04-23 15:50:39,704 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.179343124 -45.662963603 156.179216994 -45.662842617 156.179155236 -45.662874401 156.179281365 -45.662995389
2021-04-23 15:50:40,384 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 58
2021-04-23 15:50:40,385 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 731 2048
2021-04-23 15:50:40,385 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 258 274
2021-04-23 15:50:40,492 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:50:40,499 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.174716949 -45.661919476 156.174591057 -45.661798624 156.174529324 -45.661830406 156.174655215 -45.661951259
2021-04-23 15:50:40,500 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.174716949 -45.661919476 156.174591057 -45.661798624 156.174529324 -45.661830406 156.174655215 -45.661951259
2021-04-23 15:50:40,930 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 59
2021-04-23 15:50:40,930 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 658 2048
2021-04-23 15:50:40,931 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 71 88
2021-04-23 15:50:41,039 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:50:41,047 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.167987333 -45.658726530 156.167861814 -45.658605973 156.167800128 -45.658637729 156.167925645 -45.658758288
2021-04-23 15:50:41,047 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.167987333 -45.658726530 156.167861814 -45.658605973 156.167800128 -45.658637729 156.167925645 -45.658758288
2021-04-23 15:50:41,721 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 60
2021-04-23 15:50:41,722 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 641 2048
2021-04-23 15:50:41,722 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 681 699
2021-04-23 15:50:41,831 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:50:41,839 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.181507045 -45.673611447 156.181380443 -45.673489678 156.181318559 -45.673521602 156.181445158 -45.673643373
2021-04-23 15:50:41,839 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.181507045 -45.673611447 156.181380443 -45.673489678 156.181318559 -45.673521602 156.181445158 -45.673643373
2021-04-23 15:50:42,267 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 61
2021-04-23 15:50:42,267 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 620 2048
2021-04-23 15:50:42,267 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 822 840
2021-04-23 15:50:42,629 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:50:42,637 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.184095390 -45.677365774 156.183968526 -45.677243686 156.183906587 -45.677275659 156.184033450 -45.677397747
2021-04-23 15:50:42,637 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.184095390 -45.677365774 156.183968526 -45.677243686 156.183906587 -45.677275659 156.184033450 -45.677397747
2021-04-23 15:50:43,069 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 62
2021-04-23 15:50:43,069 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 570 2032
2021-04-23 15:50:43,069 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 510 528
2021-04-23 15:50:43,179 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:50:43,186 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.175200333 -45.670700849 156.175074128 -45.670579384 156.175012293 -45.670611285 156.175138497 -45.670732752
2021-04-23 15:50:43,186 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.175200333 -45.670700849 156.175074128 -45.670579384 156.175012293 -45.670611285 156.175138497 -45.670732752
2021-04-23 15:50:43,869 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 63
2021-04-23 15:50:43,869 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 454 1915
2021-04-23 15:50:43,869 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 181 200
2021-04-23 15:50:43,978 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:50:43,986 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.163846800 -45.664818400 156.163721256 -45.664697497 156.163659498 -45.664729348 156.163785040 -45.664850252
2021-04-23 15:50:43,986 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.163846800 -45.664818400 156.163721256 -45.664697497 156.163659498 -45.664729348 156.163785040 -45.664850252
2021-04-23 15:50:44,418 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 64
2021-04-23 15:50:44,418 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 454 1915
2021-04-23 15:50:44,419 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 176 195
2021-04-23 15:50:44,530 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:50:44,538 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.163724974 -45.664701077 156.163599439 -45.664580184 156.163537682 -45.664612033 156.163663216 -45.664732928
2021-04-23 15:50:44,538 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.163724974 -45.664701077 156.163599439 -45.664580184 156.163537682 -45.664612033 156.163663216 -45.664732928
2021-04-23 15:50:45,246 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 67
2021-04-23 15:50:45,247 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 328 1789
2021-04-23 15:50:45,247 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 130 150
2021-04-23 15:50:45,360 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:50:45,368 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.158533940 -45.665758025 156.158408563 -45.665637125 156.158346784 -45.665669007 156.158472159 -45.665789909
2021-04-23 15:50:45,368 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.158533940 -45.665758025 156.158408563 -45.665637125 156.158346784 -45.665669007 156.158472159 -45.665789909
2021-04-23 15:50:46,070 - stpipe.Extract2dStep - INFO - Step Extract2dStep done
2021-04-23 15:50:48,205 - stpipe.SourceTypeStep - INFO - SourceTypeStep instance created.
2021-04-23 15:50:48,473 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep running with args (<MultiSlitModel from mos_g140m_line1_NRS1_uncal.fits>,).
2021-04-23 15:50:48,475 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-04-23 15:50:48,482 - stpipe.SourceTypeStep - INFO - Input EXP_TYPE is NRS_MSASPEC
2021-04-23 15:50:48,483 - stpipe.SourceTypeStep - INFO - source_id=53, stellarity=0.0000, type=EXTENDED
2021-04-23 15:50:48,483 - stpipe.SourceTypeStep - INFO - source_id=54, stellarity=0.0000, type=EXTENDED
2021-04-23 15:50:48,483 - stpipe.SourceTypeStep - INFO - source_id=42, stellarity=0.0000, type=EXTENDED
2021-04-23 15:50:48,484 - stpipe.SourceTypeStep - INFO - source_id=43, stellarity=0.0000, type=EXTENDED
2021-04-23 15:50:48,484 - stpipe.SourceTypeStep - INFO - source_id=44, stellarity=0.0000, type=EXTENDED
2021-04-23 15:50:48,485 - stpipe.SourceTypeStep - INFO - source_id=45, stellarity=0.0000, type=EXTENDED
2021-04-23 15:50:48,486 - stpipe.SourceTypeStep - INFO - source_id=46, stellarity=0.0000, type=EXTENDED
2021-04-23 15:50:48,486 - stpipe.SourceTypeStep - INFO - source_id=47, stellarity=0.0000, type=EXTENDED
2021-04-23 15:50:48,487 - stpipe.SourceTypeStep - INFO - source_id=48, stellarity=0.0000, type=EXTENDED
2021-04-23 15:50:48,487 - stpipe.SourceTypeStep - INFO - source_id=49, stellarity=0.0000, type=EXTENDED
2021-04-23 15:50:48,488 - stpipe.SourceTypeStep - INFO - source_id=50, stellarity=0.0000, type=EXTENDED
2021-04-23 15:50:48,488 - stpipe.SourceTypeStep - INFO - source_id=51, stellarity=0.0000, type=EXTENDED
2021-04-23 15:50:48,489 - stpipe.SourceTypeStep - INFO - source_id=52, stellarity=0.0000, type=EXTENDED
2021-04-23 15:50:48,490 - stpipe.SourceTypeStep - INFO - source_id=55, stellarity=0.0000, type=EXTENDED
2021-04-23 15:50:48,490 - stpipe.SourceTypeStep - INFO - source_id=65, stellarity=0.0000, type=EXTENDED
2021-04-23 15:50:48,491 - stpipe.SourceTypeStep - INFO - source_id=66, stellarity=0.0000, type=EXTENDED
2021-04-23 15:50:48,491 - stpipe.SourceTypeStep - INFO - source_id=68, stellarity=0.0000, type=EXTENDED
2021-04-23 15:50:48,491 - stpipe.SourceTypeStep - INFO - source_id=56, stellarity=0.0000, type=EXTENDED
2021-04-23 15:50:48,492 - stpipe.SourceTypeStep - INFO - source_id=57, stellarity=0.0000, type=EXTENDED
2021-04-23 15:50:48,492 - stpipe.SourceTypeStep - INFO - source_id=58, stellarity=0.0000, type=EXTENDED
2021-04-23 15:50:48,493 - stpipe.SourceTypeStep - INFO - source_id=59, stellarity=0.0000, type=EXTENDED
2021-04-23 15:50:48,493 - stpipe.SourceTypeStep - INFO - source_id=60, stellarity=0.0000, type=EXTENDED
2021-04-23 15:50:48,494 - stpipe.SourceTypeStep - INFO - source_id=61, stellarity=0.0000, type=EXTENDED
2021-04-23 15:50:48,494 - stpipe.SourceTypeStep - INFO - source_id=62, stellarity=0.0000, type=EXTENDED
2021-04-23 15:50:48,495 - stpipe.SourceTypeStep - INFO - source_id=63, stellarity=0.0000, type=EXTENDED
2021-04-23 15:50:48,496 - stpipe.SourceTypeStep - INFO - source_id=64, stellarity=0.0000, type=EXTENDED
2021-04-23 15:50:48,496 - stpipe.SourceTypeStep - INFO - source_id=67, stellarity=0.0000, type=EXTENDED
2021-04-23 15:50:48,497 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep done
2021-04-23 15:50:48,557 - stpipe.WavecorrStep - INFO - WavecorrStep instance created.
2021-04-23 15:50:48,779 - stpipe.WavecorrStep - INFO - Step WavecorrStep running with args (<MultiSlitModel from mos_g140m_line1_NRS1_uncal.fits>,).
2021-04-23 15:50:48,780 - stpipe.WavecorrStep - INFO - Step WavecorrStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-04-23 15:50:48,847 - stpipe.WavecorrStep - INFO - Using WAVECORR reference file /grp/crds/cache/references/jwst/jwst_nirspec_wavecorr_0002.asdf
2021-04-23 15:50:52,264 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 53
2021-04-23 15:50:52,264 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 54
2021-04-23 15:50:52,265 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 42
2021-04-23 15:50:52,265 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 43
2021-04-23 15:50:52,265 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 44
2021-04-23 15:50:52,265 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 45
2021-04-23 15:50:52,266 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 46
2021-04-23 15:50:52,266 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 47
2021-04-23 15:50:52,266 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 48
2021-04-23 15:50:52,266 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 49
2021-04-23 15:50:52,267 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 50
2021-04-23 15:50:52,267 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 51
2021-04-23 15:50:52,267 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 52
2021-04-23 15:50:52,268 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 55
2021-04-23 15:50:52,268 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 65
2021-04-23 15:50:52,268 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 66
2021-04-23 15:50:52,268 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 68
2021-04-23 15:50:52,269 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 56
2021-04-23 15:50:52,269 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 57
2021-04-23 15:50:52,269 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 58
2021-04-23 15:50:52,269 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 59
2021-04-23 15:50:52,270 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 60
2021-04-23 15:50:52,270 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 61
2021-04-23 15:50:52,270 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 62
2021-04-23 15:50:52,270 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 63
2021-04-23 15:50:52,271 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 64
2021-04-23 15:50:52,271 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 67
2021-04-23 15:50:52,272 - stpipe.WavecorrStep - INFO - Step WavecorrStep done
2021-04-23 15:50:52,323 - stpipe.FlatFieldStep - INFO - FlatFieldStep instance created.
2021-04-23 15:50:52,710 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep running with args (<MultiSlitModel from mos_g140m_line1_NRS1_uncal.fits>,).
2021-04-23 15:50:52,712 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': True, 'user_supplied_flat': None, 'inverse': False}
2021-04-23 15:51:02,259 - stpipe.FlatFieldStep - INFO - Working on slit 53
2021-04-23 15:51:02,957 - stpipe.FlatFieldStep - INFO - Working on slit 54
2021-04-23 15:51:03,660 - stpipe.FlatFieldStep - INFO - Working on slit 42
2021-04-23 15:51:03,767 - stpipe.FlatFieldStep - INFO - Working on slit 43
2021-04-23 15:51:03,934 - stpipe.FlatFieldStep - INFO - Working on slit 44
2021-04-23 15:51:04,096 - stpipe.FlatFieldStep - INFO - Working on slit 45
2021-04-23 15:51:04,334 - stpipe.FlatFieldStep - INFO - Working on slit 46
2021-04-23 15:51:04,638 - stpipe.FlatFieldStep - INFO - Working on slit 47
2021-04-23 15:51:04,988 - stpipe.FlatFieldStep - INFO - Working on slit 48
2021-04-23 15:51:05,339 - stpipe.FlatFieldStep - INFO - Working on slit 49
2021-04-23 15:51:05,730 - stpipe.FlatFieldStep - INFO - Working on slit 50
2021-04-23 15:51:06,136 - stpipe.FlatFieldStep - INFO - Working on slit 51
2021-04-23 15:51:06,556 - stpipe.FlatFieldStep - INFO - Working on slit 52
2021-04-23 15:51:07,024 - stpipe.FlatFieldStep - INFO - Working on slit 55
2021-04-23 15:51:08,370 - stpipe.FlatFieldStep - INFO - Working on slit 65
2021-04-23 15:51:10,318 - stpipe.FlatFieldStep - INFO - Working on slit 66
2021-04-23 15:51:12,272 - stpipe.FlatFieldStep - INFO - Working on slit 68
2021-04-23 15:51:14,221 - stpipe.FlatFieldStep - INFO - Working on slit 56
2021-04-23 15:51:15,773 - stpipe.FlatFieldStep - INFO - Working on slit 57
2021-04-23 15:51:17,457 - stpipe.FlatFieldStep - INFO - Working on slit 58
2021-04-23 15:51:19,218 - stpipe.FlatFieldStep - INFO - Working on slit 59
2021-04-23 15:51:21,058 - stpipe.FlatFieldStep - INFO - Working on slit 60
2021-04-23 15:51:22,891 - stpipe.FlatFieldStep - INFO - Working on slit 61
2021-04-23 15:51:24,747 - stpipe.FlatFieldStep - INFO - Working on slit 62
2021-04-23 15:51:26,655 - stpipe.FlatFieldStep - INFO - Working on slit 63
2021-04-23 15:51:28,599 - stpipe.FlatFieldStep - INFO - Working on slit 64
2021-04-23 15:51:30,543 - stpipe.FlatFieldStep - INFO - Working on slit 67
2021-04-23 15:51:37,141 - stpipe.FlatFieldStep - INFO - Saved model in mos_g140m_line1_NRS1_interpolatedflat.fits
2021-04-23 15:51:37,142 - stpipe.FlatFieldStep - INFO - Interpolated flat written to "mos_g140m_line1_NRS1_interpolatedflat.fits".
2021-04-23 15:51:37,143 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep done
Running flat field test for MOS... Filename: mos_g140m_line1_NRS1_interpolatedflat.fits No. Name Ver Type Cards Dimensions Format 0 PRIMARY 1 PrimaryHDU 278 () 1 SCI 1 ImageHDU 14 (506, 14) float32 2 DQ 1 ImageHDU 11 (506, 14) int32 (rescales to uint32) 3 ERR 1 ImageHDU 9 (506, 14) float32 4 WAVELENGTH 1 ImageHDU 9 (506, 14) float32 5 SCI 2 ImageHDU 14 (506, 14) float32 6 DQ 2 ImageHDU 11 (506, 14) int32 (rescales to uint32) 7 ERR 2 ImageHDU 9 (506, 14) float32 8 WAVELENGTH 2 ImageHDU 9 (506, 14) float32 9 SCI 3 ImageHDU 14 (30, 17) float32 10 DQ 3 ImageHDU 11 (30, 17) int32 (rescales to uint32) 11 ERR 3 ImageHDU 9 (30, 17) float32 12 WAVELENGTH 3 ImageHDU 9 (30, 17) float32 13 SCI 4 ImageHDU 14 (78, 16) float32 14 DQ 4 ImageHDU 11 (78, 16) int32 (rescales to uint32) 15 ERR 4 ImageHDU 9 (78, 16) float32 16 WAVELENGTH 4 ImageHDU 9 (78, 16) float32 17 SCI 5 ImageHDU 14 (79, 16) float32 18 DQ 5 ImageHDU 11 (79, 16) int32 (rescales to uint32) 19 ERR 5 ImageHDU 9 (79, 16) float32 20 WAVELENGTH 5 ImageHDU 9 (79, 16) float32 21 SCI 6 ImageHDU 14 (140, 16) float32 22 DQ 6 ImageHDU 11 (140, 16) int32 (rescales to uint32) 23 ERR 6 ImageHDU 9 (140, 16) float32 24 WAVELENGTH 6 ImageHDU 9 (140, 16) float32 25 SCI 7 ImageHDU 14 (166, 16) float32 26 DQ 7 ImageHDU 11 (166, 16) int32 (rescales to uint32) 27 ERR 7 ImageHDU 9 (166, 16) float32 28 WAVELENGTH 7 ImageHDU 9 (166, 16) float32 29 SCI 8 ImageHDU 14 (233, 15) float32 30 DQ 8 ImageHDU 11 (233, 15) int32 (rescales to uint32) 31 ERR 8 ImageHDU 9 (233, 15) float32 32 WAVELENGTH 8 ImageHDU 9 (233, 15) float32 33 SCI 9 ImageHDU 14 (233, 15) float32 34 DQ 9 ImageHDU 11 (233, 15) int32 (rescales to uint32) 35 ERR 9 ImageHDU 9 (233, 15) float32 36 WAVELENGTH 9 ImageHDU 9 (233, 15) float32 37 SCI 10 ImageHDU 14 (257, 15) float32 38 DQ 10 ImageHDU 11 (257, 15) int32 (rescales to uint32) 39 ERR 10 ImageHDU 9 (257, 15) float32 40 WAVELENGTH 10 ImageHDU 9 (257, 15) float32 41 SCI 11 ImageHDU 14 (274, 15) float32 42 DQ 11 ImageHDU 11 (274, 15) int32 (rescales to uint32) 43 ERR 11 ImageHDU 9 (274, 15) float32 44 WAVELENGTH 11 ImageHDU 9 (274, 15) float32 45 SCI 12 ImageHDU 14 (289, 15) float32 46 DQ 12 ImageHDU 11 (289, 15) int32 (rescales to uint32) 47 ERR 12 ImageHDU 9 (289, 15) float32 48 WAVELENGTH 12 ImageHDU 9 (289, 15) float32 49 SCI 13 ImageHDU 14 (326, 14) float32 50 DQ 13 ImageHDU 11 (326, 14) int32 (rescales to uint32) 51 ERR 13 ImageHDU 9 (326, 14) float32 52 WAVELENGTH 13 ImageHDU 9 (326, 14) float32 53 SCI 14 ImageHDU 14 (1026, 15) float32 54 DQ 14 ImageHDU 11 (1026, 15) int32 (rescales to uint32) 55 ERR 14 ImageHDU 9 (1026, 15) float32 56 WAVELENGTH 14 ImageHDU 9 (1026, 15) float32 57 SCI 15 ImageHDU 14 (1466, 22) float32 58 DQ 15 ImageHDU 11 (1466, 22) int32 (rescales to uint32) 59 ERR 15 ImageHDU 9 (1466, 22) float32 60 WAVELENGTH 15 ImageHDU 9 (1466, 22) float32 61 SCI 16 ImageHDU 14 (1466, 22) float32 62 DQ 16 ImageHDU 11 (1466, 22) int32 (rescales to uint32) 63 ERR 16 ImageHDU 9 (1466, 22) float32 64 WAVELENGTH 16 ImageHDU 9 (1466, 22) float32 65 SCI 17 ImageHDU 14 (1467, 23) float32 66 DQ 17 ImageHDU 11 (1467, 23) int32 (rescales to uint32) 67 ERR 17 ImageHDU 9 (1467, 23) float32 68 WAVELENGTH 17 ImageHDU 9 (1467, 23) float32 69 SCI 18 ImageHDU 14 (1176, 15) float32 70 DQ 18 ImageHDU 11 (1176, 15) int32 (rescales to uint32) 71 ERR 18 ImageHDU 9 (1176, 15) float32 72 WAVELENGTH 18 ImageHDU 9 (1176, 15) float32 73 SCI 19 ImageHDU 14 (1243, 16) float32 74 DQ 19 ImageHDU 11 (1243, 16) int32 (rescales to uint32) 75 ERR 19 ImageHDU 9 (1243, 16) float32 76 WAVELENGTH 19 ImageHDU 9 (1243, 16) float32 77 SCI 20 ImageHDU 14 (1317, 16) float32 78 DQ 20 ImageHDU 11 (1317, 16) int32 (rescales to uint32) 79 ERR 20 ImageHDU 9 (1317, 16) float32 80 WAVELENGTH 20 ImageHDU 9 (1317, 16) float32 81 SCI 21 ImageHDU 14 (1390, 17) float32 82 DQ 21 ImageHDU 11 (1390, 17) int32 (rescales to uint32) 83 ERR 21 ImageHDU 9 (1390, 17) float32 84 WAVELENGTH 21 ImageHDU 9 (1390, 17) float32 85 SCI 22 ImageHDU 14 (1407, 18) float32 86 DQ 22 ImageHDU 11 (1407, 18) int32 (rescales to uint32) 87 ERR 22 ImageHDU 9 (1407, 18) float32 88 WAVELENGTH 22 ImageHDU 9 (1407, 18) float32 89 SCI 23 ImageHDU 14 (1428, 18) float32 90 DQ 23 ImageHDU 11 (1428, 18) int32 (rescales to uint32) 91 ERR 23 ImageHDU 9 (1428, 18) float32 92 WAVELENGTH 23 ImageHDU 9 (1428, 18) float32 93 SCI 24 ImageHDU 14 (1462, 18) float32 94 DQ 24 ImageHDU 11 (1462, 18) int32 (rescales to uint32) 95 ERR 24 ImageHDU 9 (1462, 18) float32 96 WAVELENGTH 24 ImageHDU 9 (1462, 18) float32 97 SCI 25 ImageHDU 14 (1461, 19) float32 98 DQ 25 ImageHDU 11 (1461, 19) int32 (rescales to uint32) 99 ERR 25 ImageHDU 9 (1461, 19) float32 100 WAVELENGTH 25 ImageHDU 9 (1461, 19) float32 101 SCI 26 ImageHDU 14 (1461, 19) float32 102 DQ 26 ImageHDU 11 (1461, 19) int32 (rescales to uint32) 103 ERR 26 ImageHDU 9 (1461, 19) float32 104 WAVELENGTH 26 ImageHDU 9 (1461, 19) float32 105 SCI 27 ImageHDU 14 (1461, 20) float32 106 DQ 27 ImageHDU 11 (1461, 20) int32 (rescales to uint32) 107 ERR 27 ImageHDU 9 (1461, 20) float32 108 WAVELENGTH 27 ImageHDU 9 (1461, 20) float32 109 ASDF 1 BinTableHDU 11 1R x 1C [1491888B]
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/gwcs/geometry.py:203: RuntimeWarning: invalid value encountered in remainder lon = np.mod(lon, 360.0 * u.deg if nquant else 360.0)
flat_field_file --> Grating:G140M Filter:F100LP LAMP:LINE1
Using D-flat: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_dflat_nrs1_f_01.03.fits
Using S-flat: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_MOS_sflat_G140M_OPAQUE_FLAT1_nrs1_f_01.01.fits
Using F-flat: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_MOS_fflat_F100LP_01.01.fits
Working with slit: 53
Subwindow origin: px0=1543 py0=1316
silt_id='53' quad=1 row=330 col=144 slitlet_id='330_144'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = -8.977e-07 median = -2.935e-07 stdev = 3.880e-04
Maximum AbsoluteFlat Difference = 3.160e-03
Minimum AbsoluteFlat Difference = -3.029e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 57%
-> 3xtheshold = 19%
-> 5xtheshold = 8%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 54
Subwindow origin: px0=1543 py0=1306
silt_id='54' quad=1 row=330 col=146 slitlet_id='330_146'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = -3.191e-06 median = -6.318e-08 stdev = 3.936e-04
Maximum AbsoluteFlat Difference = 3.336e-03
Minimum AbsoluteFlat Difference = -3.099e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 56%
-> 3xtheshold = 19%
-> 5xtheshold = 8%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 42
Subwindow origin: px0=2019 py0=546
silt_id='42' quad=2 row=138 col=56 slitlet_id='138_56'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = 6.178e-05 median = 2.610e-07 stdev = 1.122e-03
Maximum AbsoluteFlat Difference = 2.895e-03
Minimum AbsoluteFlat Difference = -3.130e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 53%
-> 3xtheshold = 47%
-> 5xtheshold = 41%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
*** WARNING: More than 10% of pixels have a median value greater than 5xthreshold!
Making histogram plot for this slitlet...
*** Result of the test: PASSED Working with slit: 43 Subwindow origin: px0=1971 py0=415 silt_id='43' quad=2 row=155 col=82 slitlet_id='155_82' Now looping through the pixels, this will take a while ...
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/nirspec_pipe_testing_tool/calwebb_spec2_pytests/auxiliary_code/flattest_mos.py:527: RuntimeWarning: invalid value encountered in true_divide sff = int_tab/(last_sfv_wav - first_sfv_wav)
Calculating statistics...
Absolute Flat Difference : mean = -2.058e-05 median = 4.416e-07 stdev = 9.017e-04
Maximum AbsoluteFlat Difference = 3.212e-03
Minimum AbsoluteFlat Difference = -3.460e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 68%
-> 3xtheshold = 44%
-> 5xtheshold = 33%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
*** WARNING: More than 10% of pixels have a median value greater than 5xthreshold!
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 44
Subwindow origin: px0=1970 py0=405
silt_id='44' quad=2 row=155 col=84 slitlet_id='155_84'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = -3.009e-05 median = 2.126e-07 stdev = 9.025e-04
Maximum AbsoluteFlat Difference = 3.116e-03
Minimum AbsoluteFlat Difference = -3.211e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 66%
-> 3xtheshold = 43%
-> 5xtheshold = 32%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
*** WARNING: More than 10% of pixels have a median value greater than 5xthreshold!
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 45
Subwindow origin: px0=1909 py0=531
silt_id='45' quad=2 row=180 col=59 slitlet_id='180_59'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = 4.402e-06 median = 4.331e-06 stdev = 6.892e-04
Maximum AbsoluteFlat Difference = 3.197e-03
Minimum AbsoluteFlat Difference = -3.299e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 62%
-> 3xtheshold = 32%
-> 5xtheshold = 22%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
*** WARNING: More than 10% of pixels have a median value greater than 5xthreshold!
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 46
Subwindow origin: px0=1883 py0=203
silt_id='46' quad=2 row=186 col=124 slitlet_id='186_124'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = -2.432e-06 median = -1.163e-06 stdev = 6.599e-04
Maximum AbsoluteFlat Difference = 3.507e-03
Minimum AbsoluteFlat Difference = -3.441e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 64%
-> 3xtheshold = 34%
-> 5xtheshold = 21%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
*** WARNING: More than 10% of pixels have a median value greater than 5xthreshold!
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 47
Subwindow origin: px0=1816 py0=567
silt_id='47' quad=2 row=216 col=52 slitlet_id='216_52'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = -3.312e-06 median = 2.203e-06 stdev = 5.587e-04
Maximum AbsoluteFlat Difference = 3.331e-03
Minimum AbsoluteFlat Difference = -3.108e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 63%
-> 3xtheshold = 31%
-> 5xtheshold = 16%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
*** WARNING: More than 10% of pixels have a median value greater than 5xthreshold!
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 48
Subwindow origin: px0=1816 py0=562
silt_id='48' quad=2 row=216 col=53 slitlet_id='216_53'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = 2.535e-06 median = 5.171e-06 stdev = 5.615e-04
Maximum AbsoluteFlat Difference = 3.132e-03
Minimum AbsoluteFlat Difference = -3.578e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 62%
-> 3xtheshold = 31%
-> 5xtheshold = 16%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
*** WARNING: More than 10% of pixels have a median value greater than 5xthreshold!
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 49
Subwindow origin: px0=1792 py0=632
silt_id='49' quad=2 row=226 col=39 slitlet_id='226_39'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = -7.313e-06 median = -1.515e-06 stdev = 5.203e-04
Maximum AbsoluteFlat Difference = 2.991e-03
Minimum AbsoluteFlat Difference = -3.641e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 63%
-> 3xtheshold = 28%
-> 5xtheshold = 14%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
*** WARNING: More than 10% of pixels have a median value greater than 5xthreshold!
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 50
Subwindow origin: px0=1775 py0=239
silt_id='50' quad=2 row=228 col=117 slitlet_id='228_117'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = -1.084e-06 median = -2.613e-06 stdev = 5.591e-04
Maximum AbsoluteFlat Difference = 3.405e-03
Minimum AbsoluteFlat Difference = -3.156e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 64%
-> 3xtheshold = 30%
-> 5xtheshold = 16%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
*** WARNING: More than 10% of pixels have a median value greater than 5xthreshold!
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 51
Subwindow origin: px0=1760 py0=431
silt_id='51' quad=2 row=236 col=79 slitlet_id='236_79'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = -2.492e-06 median = -2.024e-07 stdev = 5.109e-04
Maximum AbsoluteFlat Difference = 3.030e-03
Minimum AbsoluteFlat Difference = -3.411e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 62%
-> 3xtheshold = 28%
-> 5xtheshold = 14%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
*** WARNING: More than 10% of pixels have a median value greater than 5xthreshold!
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 52
Subwindow origin: px0=1723 py0=804
silt_id='52' quad=2 row=255 col=5 slitlet_id='255_5'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = -6.027e-06 median = -6.395e-07 stdev = 4.645e-04
Maximum AbsoluteFlat Difference = 3.024e-03
Minimum AbsoluteFlat Difference = -3.256e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 60%
-> 3xtheshold = 25%
-> 5xtheshold = 12%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
*** WARNING: More than 10% of pixels have a median value greater than 5xthreshold!
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 55
Subwindow origin: px0=1023 py0=1416
silt_id='55' quad=3 row=82 col=124 slitlet_id='82_124'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = -1.712e-06 median = -1.278e-06 stdev = 2.924e-04
Maximum AbsoluteFlat Difference = 2.817e-03
Minimum AbsoluteFlat Difference = -3.275e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 47%
-> 3xtheshold = 11%
-> 5xtheshold = 4%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 65
Subwindow origin: px0=428 py0=1252
silt_id='65' quad=3 row=310 col=156 slitlet_id='310_156'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = 7.258e-07 median = 3.305e-08 stdev = 2.606e-04
Maximum AbsoluteFlat Difference = 3.521e-03
Minimum AbsoluteFlat Difference = -3.369e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 43%
-> 3xtheshold = 9%
-> 5xtheshold = 3%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 66
Subwindow origin: px0=427 py0=1453
silt_id='66' quad=3 row=314 col=116 slitlet_id='314_116'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = 5.087e-08 median = 2.711e-07 stdev = 2.596e-04
Maximum AbsoluteFlat Difference = 2.925e-03
Minimum AbsoluteFlat Difference = -3.568e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 42%
-> 3xtheshold = 8%
-> 5xtheshold = 3%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 68
Subwindow origin: px0=376 py0=1477
silt_id='68' quad=3 row=334 col=111 slitlet_id='334_111'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = -1.918e-06 median = -3.851e-07 stdev = 2.591e-04
Maximum AbsoluteFlat Difference = 2.790e-03
Minimum AbsoluteFlat Difference = -3.444e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 43%
-> 3xtheshold = 8%
-> 5xtheshold = 3%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 56
Subwindow origin: px0=873 py0=769
silt_id='56' quad=4 row=130 col=12 slitlet_id='130_12'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = -3.948e-06 median = -3.402e-07 stdev = 2.819e-04
Maximum AbsoluteFlat Difference = 2.920e-03
Minimum AbsoluteFlat Difference = -3.276e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 47%
-> 3xtheshold = 11%
-> 5xtheshold = 4%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 57
Subwindow origin: px0=806 py0=355
silt_id='57' quad=4 row=150 col=94 slitlet_id='150_94'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = -1.176e-06 median = -8.547e-07 stdev = 2.862e-04
Maximum AbsoluteFlat Difference = 3.463e-03
Minimum AbsoluteFlat Difference = -3.578e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 46%
-> 3xtheshold = 10%
-> 5xtheshold = 4%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 58
Subwindow origin: px0=732 py0=259
silt_id='58' quad=4 row=177 col=113 slitlet_id='177_113'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = -1.126e-06 median = -1.079e-06 stdev = 2.839e-04
Maximum AbsoluteFlat Difference = 4.031e-03
Minimum AbsoluteFlat Difference = -3.660e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 46%
-> 3xtheshold = 10%
-> 5xtheshold = 3%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 59
Subwindow origin: px0=659 py0=72
silt_id='59' quad=4 row=203 col=150 slitlet_id='203_150'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = 1.470e-06 median = 6.050e-07 stdev = 2.819e-04
Maximum AbsoluteFlat Difference = 3.525e-03
Minimum AbsoluteFlat Difference = -3.111e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 45%
-> 3xtheshold = 10%
-> 5xtheshold = 4%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 60
Subwindow origin: px0=642 py0=682
silt_id='60' quad=4 row=218 col=29 slitlet_id='218_29'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = -9.855e-07 median = -1.076e-06 stdev = 2.818e-04
Maximum AbsoluteFlat Difference = 3.695e-03
Minimum AbsoluteFlat Difference = -3.349e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 45%
-> 3xtheshold = 10%
-> 5xtheshold = 4%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 61
Subwindow origin: px0=621 py0=823
silt_id='61' quad=4 row=228 col=1 slitlet_id='228_1'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = -2.516e-07 median = -8.560e-07 stdev = 2.707e-04
Maximum AbsoluteFlat Difference = 3.385e-03
Minimum AbsoluteFlat Difference = -3.442e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 44%
-> 3xtheshold = 10%
-> 5xtheshold = 3%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 62
Subwindow origin: px0=571 py0=511
silt_id='62' quad=4 row=243 col=63 slitlet_id='243_63'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = 9.825e-07 median = -1.237e-07 stdev = 2.749e-04
Maximum AbsoluteFlat Difference = 3.040e-03
Minimum AbsoluteFlat Difference = -3.424e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 44%
-> 3xtheshold = 9%
-> 5xtheshold = 4%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 63
Subwindow origin: px0=455 py0=182
silt_id='63' quad=4 row=283 col=128 slitlet_id='283_128'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = 2.434e-06 median = -1.413e-07 stdev = 2.637e-04
Maximum AbsoluteFlat Difference = 3.251e-03
Minimum AbsoluteFlat Difference = -3.270e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 45%
-> 3xtheshold = 9%
-> 5xtheshold = 3%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 64
Subwindow origin: px0=455 py0=177
silt_id='64' quad=4 row=283 col=129 slitlet_id='283_129'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = -1.588e-06 median = 6.770e-07 stdev = 2.666e-04
Maximum AbsoluteFlat Difference = 3.242e-03
Minimum AbsoluteFlat Difference = -3.409e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 43%
-> 3xtheshold = 9%
-> 5xtheshold = 3%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 67
Subwindow origin: px0=329 py0=131
silt_id='67' quad=4 row=331 col=138 slitlet_id='331_138'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = 3.444e-07 median = 5.367e-07 stdev = 2.700e-04
Maximum AbsoluteFlat Difference = 3.332e-03
Minimum AbsoluteFlat Difference = -3.099e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 45%
-> 3xtheshold = 10%
-> 5xtheshold = 3%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
*** Final result for flat_field test will be reported as PASSED ***
('* Script flattest_mos.py took ', '2.463071099917094 minutes to finish.')
Did flat_field validation test passed? All slitlets PASSED flat_field test.
Closing file: popenfile(path='/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_dflat_nrs1_f_01.03.fits', fd=49, position=680480640, mode='r', flags=557056)
Closing file: popenfile(path='/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_MOS_sflat_G140M_OPAQUE_FLAT1_nrs1_f_01.01.fits', fd=58, position=1006715520, mode='r', flags=557056)
Closing file: popenfile(path='/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_MOS_fflat_F100LP_01.01.fits', fd=59, position=299989440, mode='r', flags=557056)
Closing file: popenfile(path='/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/V8460001000101_msa.fits', fd=60, position=512640, mode='r', flags=557056)
Closing file: popenfile(path='/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/mos_g140m_line1_NRS1_interpolatedflat.fits', fd=61, position=6560640, mode='r', flags=557056)
Testing files for detector: nrs2
Working with uncal_file: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/mos_g140m_line1_NRS2_uncal.fits
2021-04-23 15:54:19,681 - stpipe - INFO - PARS-DETECTOR1PIPELINE parameters found: /grp/crds/cache/references/jwst/jwst_nirspec_pars-detector1pipeline_0004.asdf
2021-04-23 15:54:19,695 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2021-04-23 15:54:19,696 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2021-04-23 15:54:19,697 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2021-04-23 15:54:19,698 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2021-04-23 15:54:19,699 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2021-04-23 15:54:19,700 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2021-04-23 15:54:19,702 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2021-04-23 15:54:19,703 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2021-04-23 15:54:19,703 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2021-04-23 15:54:19,704 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2021-04-23 15:54:19,706 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2021-04-23 15:54:19,707 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2021-04-23 15:54:19,708 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2021-04-23 15:54:19,709 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2021-04-23 15:54:19,711 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2021-04-23 15:54:19,712 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2021-04-23 15:54:19,713 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/stpipe/step.py:359: ResourceWarning: unclosed file <_io.FileIO name='/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/mos_g140m_line1_NRS2_uncal.fits' mode='rb' closefd=True>
gc.collect()
2021-04-23 15:54:20,296 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/mos_g140m_line1_NRS2_uncal.fits',).
2021-04-23 15:54:20,305 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 4.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 200.0, 'min_jump_to_flag_neighbors': 10.0}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2021-04-23 15:54:20,401 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'mos_g140m_line1_NRS2_uncal.fits' reftypes = ['dark', 'gain', 'linearity', 'mask', 'persat', 'readnoise', 'refpix', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2021-04-23 15:54:20,415 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_dark_0143.fits'.
2021-04-23 15:54:20,417 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_gain_0018.fits'.
2021-04-23 15:54:20,421 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_linearity_0020.fits'.
2021-04-23 15:54:20,425 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_mask_0025.fits'.
2021-04-23 15:54:20,427 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2021-04-23 15:54:20,427 - stpipe.Detector1Pipeline - INFO - Prefetch for READNOISE reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0016.fits'.
2021-04-23 15:54:20,429 - stpipe.Detector1Pipeline - INFO - Prefetch for REFPIX reference file is 'N/A'.
2021-04-23 15:54:20,430 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is 'N/A'.
2021-04-23 15:54:20,430 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is 'N/A'.
2021-04-23 15:54:20,430 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_saturation_0022.fits'.
2021-04-23 15:54:20,432 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_superbias_0104.fits'.
2021-04-23 15:54:20,434 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2021-04-23 15:54:20,434 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2021-04-23 15:54:20,434 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2021-04-23 15:54:21,192 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS2_uncal.fits>,).
2021-04-23 15:54:21,194 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:54:21,285 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES and FRMDIVSR are equal; correction not needed
2021-04-23 15:54:21,286 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2021-04-23 15:54:21,287 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2021-04-23 15:54:21,911 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS2_uncal.fits>,).
2021-04-23 15:54:21,913 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:54:21,932 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_nirspec_mask_0025.fits
2021-04-23 15:54:22,168 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2021-04-23 15:54:22,781 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS2_uncal.fits>,).
2021-04-23 15:54:22,782 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:54:22,800 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_nirspec_saturation_0022.fits
2021-04-23 15:54:23,317 - stpipe.Detector1Pipeline.saturation - INFO - Detected 83201 saturated pixels
2021-04-23 15:54:23,338 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2021-04-23 15:54:23,348 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2021-04-23 15:54:23,939 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS2_uncal.fits>,).
2021-04-23 15:54:23,941 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:54:23,941 - stpipe.Detector1Pipeline.ipc - INFO - Step skipped.
2021-04-23 15:54:23,942 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2021-04-23 15:54:24,529 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS2_uncal.fits>,).
2021-04-23 15:54:24,531 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:54:24,550 - stpipe.Detector1Pipeline.superbias - INFO - Using SUPERBIAS reference file /grp/crds/cache/references/jwst/jwst_nirspec_superbias_0104.fits
2021-04-23 15:54:24,953 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias done
2021-04-23 15:54:25,545 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS2_uncal.fits>,).
2021-04-23 15:54:25,547 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2021-04-23 15:54:25,554 - stpipe.Detector1Pipeline.refpix - INFO - use_side_ref_pixels = True
2021-04-23 15:54:25,555 - stpipe.Detector1Pipeline.refpix - INFO - odd_even_columns = True
2021-04-23 15:54:25,555 - stpipe.Detector1Pipeline.refpix - INFO - side_smoothing_length = 11
2021-04-23 15:54:25,556 - stpipe.Detector1Pipeline.refpix - INFO - side_gain = 1.000000
2021-04-23 15:54:25,556 - stpipe.Detector1Pipeline.refpix - INFO - odd_even_rows = True
2021-04-23 15:54:28,941 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2021-04-23 15:54:29,544 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS2_uncal.fits>,).
2021-04-23 15:54:29,545 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:54:29,564 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_nirspec_linearity_0020.fits
2021-04-23 15:54:30,389 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2021-04-23 15:54:31,044 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS2_uncal.fits>,).
2021-04-23 15:54:31,046 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4', 'dark_output': None}
2021-04-23 15:54:31,065 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_nirspec_dark_0143.fits
2021-04-23 15:54:31,301 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=1, ngroups=6, nframes=1, groupgap=0
2021-04-23 15:54:31,302 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=1, ngroups=10, nframes=1, groupgap=0
2021-04-23 15:54:31,511 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2021-04-23 15:54:32,132 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS2_uncal.fits>,).
2021-04-23 15:54:32,134 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4', 'rejection_threshold': 4.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 200.0, 'min_jump_to_flag_neighbors': 10.0}
2021-04-23 15:54:32,142 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 4 sigma
2021-04-23 15:54:32,153 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0018.fits
2021-04-23 15:54:32,201 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0016.fits
2021-04-23 15:54:32,240 - stpipe.Detector1Pipeline.jump - INFO - Found 32 possible cores to use for jump detection
2021-04-23 15:54:32,443 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2021-04-23 15:54:32,696 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
2021-04-23 15:54:34,370 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 63824 pixels with at least one CR
2021-04-23 15:54:36,981 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 4.53693 sec
2021-04-23 15:54:36,983 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 4.841017
2021-04-23 15:54:36,984 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2021-04-23 15:54:37,615 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS2_uncal.fits>,).
2021-04-23 15:54:37,617 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}
2021-04-23 15:54:37,645 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0016.fits
2021-04-23 15:54:37,679 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0018.fits
2021-04-23 15:54:37,722 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2021-04-23 15:54:37,722 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/jwst/ramp_fitting/ramp_fit.py:872: RuntimeWarning: invalid value encountered in multiply
var_p4[num_int,:,:,:] *= ( segs_4[num_int,:,:,:] > 0)
2021-04-23 15:55:03,593 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 6
2021-04-23 15:55:03,594 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 1
2021-04-23 15:55:03,713 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2021-04-23 15:55:04,389 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<ImageModel(2048, 2048) from mos_g140m_line1_NRS2_uncal.fits>,).
2021-04-23 15:55:04,390 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:55:04,460 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2021-04-23 15:55:04,460 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2021-04-23 15:55:04,462 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2021-04-23 15:55:05,079 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(1, 2048, 2048) from mos_g140m_line1_NRS2_uncal.fits>,).
2021-04-23 15:55:05,081 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 15:55:05,134 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2021-04-23 15:55:05,135 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2021-04-23 15:55:05,136 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2021-04-23 15:55:05,137 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2021-04-23 15:55:05,138 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2021-04-23 15:55:05,149 - stpipe.AssignWcsStep - INFO - AssignWcsStep instance created.
2021-04-23 15:55:05,817 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep running with args (<ImageModel(2048, 2048) from mos_g140m_line1_NRS2_uncal.fits>,).
2021-04-23 15:55:05,819 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2021-04-23 15:55:06,066 - stpipe.AssignWcsStep - INFO - Retrieving open MSA slitlets for msa_metadata_id = 1 and dither_index = 1
2021-04-23 15:55:06,274 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.1260581910610199 deg
2021-04-23 15:55:06,274 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3316612243652344 deg
2021-04-23 15:55:06,275 - stpipe.AssignWcsStep - INFO - theta_y correction: 0.0002496099796717191 deg
2021-04-23 15:55:06,276 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2021-04-23 15:55:07,170 - stpipe.AssignWcsStep - INFO - Removing slit 65 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:55:07,185 - stpipe.AssignWcsStep - INFO - Removing slit 66 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:55:07,200 - stpipe.AssignWcsStep - INFO - Removing slit 68 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:55:07,245 - stpipe.AssignWcsStep - INFO - Removing slit 58 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:55:07,261 - stpipe.AssignWcsStep - INFO - Removing slit 59 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:55:07,277 - stpipe.AssignWcsStep - INFO - Removing slit 60 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:55:07,293 - stpipe.AssignWcsStep - INFO - Removing slit 61 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:55:07,308 - stpipe.AssignWcsStep - INFO - Removing slit 62 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:55:07,327 - stpipe.AssignWcsStep - INFO - Removing slit 63 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:55:07,342 - stpipe.AssignWcsStep - INFO - Removing slit 64 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:55:07,357 - stpipe.AssignWcsStep - INFO - Removing slit 67 from the list of open slits because the WCS bounding_box is completely outside the detector.
2021-04-23 15:55:07,358 - stpipe.AssignWcsStep - INFO - Slits projected on detector NRS2: [1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57]
2021-04-23 15:55:07,359 - stpipe.AssignWcsStep - INFO - Computing WCS for 57 open slitlets
2021-04-23 15:55:07,374 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.1260581910610199 deg
2021-04-23 15:55:07,374 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3316612243652344 deg
2021-04-23 15:55:07,375 - stpipe.AssignWcsStep - INFO - theta_y correction: 0.0002496099796717191 deg
2021-04-23 15:55:07,376 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2021-04-23 15:55:07,384 - stpipe.AssignWcsStep - INFO - SPORDER= -1, wrange=[9.7e-07, 1.89e-06]
2021-04-23 15:55:07,490 - stpipe.AssignWcsStep - INFO - There are 27 open slits in quadrant 1
2021-04-23 15:55:07,740 - stpipe.AssignWcsStep - INFO - There are 27 open slits in quadrant 2
2021-04-23 15:55:07,964 - stpipe.AssignWcsStep - INFO - There are 1 open slits in quadrant 3
2021-04-23 15:55:07,974 - stpipe.AssignWcsStep - INFO - There are 2 open slits in quadrant 4
2021-04-23 15:55:07,991 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 5
2021-04-23 15:55:08,134 - stpipe.AssignWcsStep - INFO - Created a NIRSPEC nrs_msaspec pipeline with references {'distortion': None, 'filteroffset': None, 'specwcs': None, 'regions': None, 'wavelengthrange': '/grp/crds/cache/references/jwst/jwst_nirspec_wavelengthrange_0004.asdf', 'camera': '/grp/crds/cache/references/jwst/jwst_nirspec_camera_0004.asdf', 'collimator': '/grp/crds/cache/references/jwst/jwst_nirspec_collimator_0004.asdf', 'disperser': '/grp/crds/cache/references/jwst/jwst_nirspec_disperser_0032.asdf', 'fore': '/grp/crds/cache/references/jwst/jwst_nirspec_fore_0023.asdf', 'fpa': '/grp/crds/cache/references/jwst/jwst_nirspec_fpa_0005.asdf', 'msa': '/grp/crds/cache/references/jwst/jwst_nirspec_msa_0005.asdf', 'ote': '/grp/crds/cache/references/jwst/jwst_nirspec_ote_0005.asdf', 'ifupost': None, 'ifufore': None, 'ifuslicer': None, 'msametafile': 'V8460001000101_msa.fits'}
2021-04-23 15:55:09,659 - stpipe.AssignWcsStep - INFO - COMPLETED assign_wcs
2021-04-23 15:55:09,663 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep done
2021-04-23 15:55:09,673 - stpipe.MSAFlagOpenStep - INFO - MSAFlagOpenStep instance created.
2021-04-23 15:55:10,209 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep running with args (<ImageModel(2048, 2048) from mos_g140m_line1_NRS2_uncal.fits>,).
2021-04-23 15:55:10,213 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-04-23 15:55:10,232 - stpipe.MSAFlagOpenStep - INFO - Using reference file /grp/crds/cache/references/jwst/jwst_nirspec_msaoper_0001.json
2021-04-23 15:55:10,234 - stpipe.JwstStep - INFO - JwstStep instance created.
2021-04-23 15:55:10,344 - stpipe.MSAFlagOpenStep - INFO - gwa_ytilt is 0.1260581910610199 deg
2021-04-23 15:55:10,344 - stpipe.MSAFlagOpenStep - INFO - gwa_xtilt is 0.3316612243652344 deg
2021-04-23 15:55:10,345 - stpipe.MSAFlagOpenStep - INFO - theta_y correction: 0.0002496099796717191 deg
2021-04-23 15:55:10,346 - stpipe.MSAFlagOpenStep - INFO - theta_x correction: 0.0 deg
2021-04-23 15:55:10,354 - stpipe.MSAFlagOpenStep - INFO - SPORDER= -1, wrange=[9.7e-07, 1.89e-06]
2021-04-23 15:55:10,450 - stpipe.MSAFlagOpenStep - INFO - There are 5 open slits in quadrant 1
2021-04-23 15:55:10,492 - stpipe.MSAFlagOpenStep - INFO - There are 3 open slits in quadrant 2
2021-04-23 15:55:10,519 - stpipe.MSAFlagOpenStep - INFO - There are 9 open slits in quadrant 3
2021-04-23 15:55:10,593 - stpipe.MSAFlagOpenStep - INFO - There are 3 open slits in quadrant 4
2021-04-23 15:55:10,619 - stpipe.MSAFlagOpenStep - INFO - There are 0 open slits in quadrant 5
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/gwcs/geometry.py:203: RuntimeWarning: invalid value encountered in remainder
lon = np.mod(lon, 360.0 * u.deg if nquant else 360.0)
2021-04-23 15:55:23,010 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep done
2021-04-23 15:55:23,021 - stpipe.Extract2dStep - INFO - Extract2dStep instance created.
2021-04-23 15:55:23,475 - stpipe.Extract2dStep - INFO - Step Extract2dStep running with args (<ImageModel(2048, 2048) from mos_g140m_line1_NRS2_uncal.fits>,).
2021-04-23 15:55:23,478 - stpipe.Extract2dStep - INFO - Step Extract2dStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'slit_name': None, 'extract_orders': None, 'tsgrism_extract_height': None, 'wfss_extract_half_height': 5, 'grism_objects': None, 'mmag_extract': 99.0}
2021-04-23 15:55:23,498 - stpipe.Extract2dStep - INFO - EXP_TYPE is NRS_MSASPEC
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/gwcs/utils.py:72: DeprecationWarning: `np.int` is a deprecated alias for the builtin `int`. To silence this warning, use `int` by itself. Doing this will not modify any behavior and is safe. When replacing `np.int`, you may wish to use e.g. `np.int64` or `np.int32` to specify the precision. If you wish to review your current use, check the release note link for additional information.
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
indx = np.asarray(np.floor(np.asarray(value) + 0.5), dtype=np.int)
2021-04-23 15:55:24,347 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 6
2021-04-23 15:55:24,348 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 138 1619
2021-04-23 15:55:24,348 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1761 1785
2021-04-23 15:55:24,531 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:55:24,540 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.263159350 -45.671304678 156.263027991 -45.671181725 156.262965146 -45.671213584 156.263096502 -45.671336538
2021-04-23 15:55:24,541 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.263159350 -45.671304678 156.263027991 -45.671181725 156.262965146 -45.671213584 156.263096502 -45.671336538
2021-04-23 15:55:25,857 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 7
2021-04-23 15:55:25,858 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 138 1619
2021-04-23 15:55:25,858 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1756 1780
2021-04-23 15:55:26,008 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:55:26,017 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.263031777 -45.671185268 156.262900430 -45.671062325 156.262837587 -45.671094183 156.262968931 -45.671217127
2021-04-23 15:55:26,018 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.263031777 -45.671185268 156.262900430 -45.671062325 156.262837587 -45.671094183 156.262968931 -45.671217127
2021-04-23 15:55:27,281 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 8
2021-04-23 15:55:27,282 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 137 1618
2021-04-23 15:55:27,283 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1806 1830
2021-04-23 15:55:27,412 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:55:27,421 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.264221225 -45.672423837 156.264089757 -45.672300789 156.264026890 -45.672332658 156.264158355 -45.672455707
2021-04-23 15:55:27,421 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.264221225 -45.672423837 156.264089757 -45.672300789 156.264026890 -45.672332658 156.264158355 -45.672455707
2021-04-23 15:55:28,734 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 9
2021-04-23 15:55:28,735 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 137 1618
2021-04-23 15:55:28,735 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1801 1825
2021-04-23 15:55:28,948 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:55:28,957 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.264093546 -45.672304335 156.263962090 -45.672181297 156.263899225 -45.672213165 156.264030678 -45.672336204
2021-04-23 15:55:28,957 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.264093546 -45.672304335 156.263962090 -45.672181297 156.263899225 -45.672213165 156.264030678 -45.672336204
2021-04-23 15:55:30,186 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 10
2021-04-23 15:55:30,187 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 137 1618
2021-04-23 15:55:30,187 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1796 1820
2021-04-23 15:55:30,329 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:55:30,337 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.263965879 -45.672184843 156.263834436 -45.672061816 156.263771574 -45.672093683 156.263903014 -45.672216711
2021-04-23 15:55:30,338 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.263965879 -45.672184843 156.263834436 -45.672061816 156.263771574 -45.672093683 156.263903014 -45.672216711
2021-04-23 15:55:31,191 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 11
2021-04-23 15:55:31,192 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 136 1617
2021-04-23 15:55:31,193 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1836 1860
2021-04-23 15:55:31,316 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:55:31,324 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.264900700 -45.673185083 156.264769161 -45.673061972 156.264706280 -45.673093849 156.264837816 -45.673216961
2021-04-23 15:55:31,324 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.264900700 -45.673185083 156.264769161 -45.673061972 156.264706280 -45.673093849 156.264837816 -45.673216961
2021-04-23 15:55:32,650 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 14
2021-04-23 15:55:32,650 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 104 1582
2021-04-23 15:55:32,651 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1221 1243
2021-04-23 15:55:32,797 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:55:32,806 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.249021000 -45.658685479 156.248891047 -45.658563629 156.248828487 -45.658595378 156.248958437 -45.658717230
2021-04-23 15:55:32,806 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.249021000 -45.658685479 156.248891047 -45.658563629 156.248828487 -45.658595378 156.248958437 -45.658717230
2021-04-23 15:55:34,106 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 15
2021-04-23 15:55:34,107 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 122 1604
2021-04-23 15:55:34,107 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1886 1910
2021-04-23 15:55:34,322 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:55:34,330 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.265657550 -45.674645528 156.265525910 -45.674522304 156.265463012 -45.674554193 156.265594650 -45.674677417
2021-04-23 15:55:34,331 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.265657550 -45.674645528 156.265525910 -45.674522304 156.265463012 -45.674554193 156.265594650 -45.674677417
2021-04-23 15:55:35,637 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 16
2021-04-23 15:55:35,638 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 117 1598
2021-04-23 15:55:35,638 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1821 1845
2021-04-23 15:55:35,829 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:55:35,837 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.263909649 -45.673134588 156.263778173 -45.673011497 156.263715311 -45.673043371 156.263846784 -45.673166463
2021-04-23 15:55:35,838 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.263909649 -45.673134588 156.263778173 -45.673011497 156.263715311 -45.673043371 156.263846784 -45.673166463
2021-04-23 15:55:36,698 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 17
2021-04-23 15:55:36,699 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 115 1597
2021-04-23 15:55:36,699 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1851 1875
2021-04-23 15:55:36,829 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:55:36,837 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.264589177 -45.673896098 156.264457630 -45.673772943 156.264394753 -45.673804824 156.264526298 -45.673927980
2021-04-23 15:55:36,838 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.264589177 -45.673896098 156.264457630 -45.673772943 156.264394753 -45.673804824 156.264526298 -45.673927980
2021-04-23 15:55:38,199 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 18
2021-04-23 15:55:38,200 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 115 1597
2021-04-23 15:55:38,201 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1846 1870
2021-04-23 15:55:38,330 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:55:38,338 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.264461421 -45.673776492 156.264329887 -45.673653347 156.264267013 -45.673685227 156.264398544 -45.673808373
2021-04-23 15:55:38,339 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.264461421 -45.673776492 156.264329887 -45.673653347 156.264267013 -45.673685227 156.264398544 -45.673808373
2021-04-23 15:55:39,618 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 19
2021-04-23 15:55:39,619 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 93 1571
2021-04-23 15:55:39,620 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1336 1358
2021-04-23 15:55:39,738 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:55:39,747 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.251408362 -45.661673296 156.251278132 -45.661551203 156.251215522 -45.661582975 156.251345749 -45.661705069
2021-04-23 15:55:39,747 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.251408362 -45.661673296 156.251278132 -45.661551203 156.251215522 -45.661582975 156.251345749 -45.661705069
2021-04-23 15:55:40,574 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 21
2021-04-23 15:55:40,575 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 89 1568
2021-04-23 15:55:40,575 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1381 1403
2021-04-23 15:55:40,694 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:55:40,702 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.252374207 -45.662828704 156.252243867 -45.662706516 156.252181238 -45.662738296 156.252311575 -45.662860485
2021-04-23 15:55:40,702 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.252374207 -45.662828704 156.252243867 -45.662706516 156.252181238 -45.662738296 156.252311575 -45.662860485
2021-04-23 15:55:41,977 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 25
2021-04-23 15:55:41,978 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 70 1547
2021-04-23 15:55:41,978 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1276 1298
2021-04-23 15:55:42,095 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:55:42,104 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.249200048 -45.660601994 156.249070003 -45.660480012 156.249007436 -45.660511773 156.249137478 -45.660633755
2021-04-23 15:55:42,104 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.249200048 -45.660601994 156.249070003 -45.660480012 156.249007436 -45.660511773 156.249137478 -45.660633755
2021-04-23 15:55:43,325 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 26
2021-04-23 15:55:43,326 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 65 1544
2021-04-23 15:55:43,326 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1562 1584
2021-04-23 15:55:43,445 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:55:43,453 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.255900113 -45.667634746 156.255769353 -45.667512168 156.255706649 -45.667543987 156.255837406 -45.667666566
2021-04-23 15:55:43,454 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.255900113 -45.667634746 156.255769353 -45.667512168 156.255706649 -45.667543987 156.255837406 -45.667666566
2021-04-23 15:55:44,293 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 27
2021-04-23 15:55:44,294 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 31 1507
2021-04-23 15:55:44,294 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1201 1222
2021-04-23 15:55:44,410 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:55:44,418 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.246097982 -45.659439921 156.245968181 -45.659318074 156.245905674 -45.659349821 156.246035471 -45.659471670
2021-04-23 15:55:44,418 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.246097982 -45.659439921 156.245968181 -45.659318074 156.245905674 -45.659349821 156.246035471 -45.659471670
2021-04-23 15:55:45,718 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 29
2021-04-23 15:55:45,719 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 22 1503
2021-04-23 15:55:45,720 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1867 1889
2021-04-23 15:55:45,837 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:55:45,845 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.261846987 -45.675840555 156.261715536 -45.675717309 156.261652705 -45.675749201 156.261784154 -45.675872448
2021-04-23 15:55:45,846 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.261846987 -45.675840555 156.261715536 -45.675717309 156.261652705 -45.675749201 156.261784154 -45.675872448
2021-04-23 15:55:47,087 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 31
2021-04-23 15:55:47,088 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 1464
2021-04-23 15:55:47,088 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1367 1388
2021-04-23 15:55:47,207 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:55:47,216 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.248622769 -45.664184605 156.248492610 -45.664062392 156.248430047 -45.664094174 156.248560203 -45.664216388
2021-04-23 15:55:47,216 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.248622769 -45.664184605 156.248492610 -45.664062392 156.248430047 -45.664094174 156.248560203 -45.664216388
2021-04-23 15:55:48,034 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 32
2021-04-23 15:55:48,035 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 1432
2021-04-23 15:55:48,035 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1352 1372
2021-04-23 15:55:48,148 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:55:48,156 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.247206881 -45.664355302 156.247076805 -45.664233103 156.247014266 -45.664264884 156.247144339 -45.664387085
2021-04-23 15:55:48,156 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.247206881 -45.664355302 156.247076805 -45.664233103 156.247014266 -45.664264884 156.247144339 -45.664387085
2021-04-23 15:55:49,417 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 33
2021-04-23 15:55:49,418 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 1418
2021-04-23 15:55:49,418 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1272 1292
2021-04-23 15:55:49,531 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:55:49,539 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.244841867 -45.662633161 156.244712012 -45.662511121 156.244649520 -45.662542887 156.244779372 -45.662664928
2021-04-23 15:55:49,539 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.244841867 -45.662633161 156.244712012 -45.662511121 156.244649520 -45.662542887 156.244779372 -45.662664928
2021-04-23 15:55:50,758 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 35
2021-04-23 15:55:50,759 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 1428
2021-04-23 15:55:50,760 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1722 1743
2021-04-23 15:55:50,876 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:55:50,884 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.255896650 -45.673517700 156.255765657 -45.673394713 156.255702938 -45.673426578 156.255833929 -45.673549566
2021-04-23 15:55:50,884 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.255896650 -45.673517700 156.255765657 -45.673394713 156.255702938 -45.673426578 156.255833929 -45.673549566
2021-04-23 15:55:52,132 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 37
2021-04-23 15:55:52,133 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 1412
2021-04-23 15:55:52,134 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1663 1683
2021-04-23 15:55:52,246 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:55:52,254 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.253937935 -45.672305027 156.253807112 -45.672182158 156.253744431 -45.672214010 156.253875252 -45.672336880
2021-04-23 15:55:52,254 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.253937935 -45.672305027 156.253807112 -45.672182158 156.253744431 -45.672214010 156.253875252 -45.672336880
2021-04-23 15:55:53,064 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 38
2021-04-23 15:55:53,065 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 1404
2021-04-23 15:55:53,065 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1603 1623
2021-04-23 15:55:53,177 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:55:53,184 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.252241050 -45.670961715 156.252110387 -45.670838969 156.252047741 -45.670870808 156.252178401 -45.670993555
2021-04-23 15:55:53,185 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.252241050 -45.670961715 156.252110387 -45.670838969 156.252047741 -45.670870808 156.252178401 -45.670993555
2021-04-23 15:55:54,552 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 39
2021-04-23 15:55:54,553 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 1385
2021-04-23 15:55:54,553 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1242 1262
2021-04-23 15:55:54,669 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:55:54,677 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.243049984 -45.662448591 156.242920250 -45.662326596 156.242857790 -45.662358358 156.242987521 -45.662480354
2021-04-23 15:55:54,677 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.243049984 -45.662448591 156.242920250 -45.662326596 156.242857790 -45.662358358 156.242987521 -45.662480354
2021-04-23 15:55:55,490 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 41
2021-04-23 15:55:55,491 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 1393
2021-04-23 15:55:55,491 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1768 1788
2021-04-23 15:55:55,602 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:55:55,610 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.255829101 -45.675209536 156.255698046 -45.675086431 156.255635323 -45.675118310 156.255766375 -45.675241415
2021-04-23 15:55:55,610 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.255829101 -45.675209536 156.255698046 -45.675086431 156.255635323 -45.675118310 156.255766375 -45.675241415
2021-04-23 15:55:56,922 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 53
2021-04-23 15:55:56,924 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 819
2021-04-23 15:55:56,924 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1315 1329
2021-04-23 15:55:57,026 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:55:57,034 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.226123221 -45.673642180 156.225994086 -45.673519691 156.225931834 -45.673551545 156.226060967 -45.673674035
2021-04-23 15:55:57,035 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.226123221 -45.673642180 156.225994086 -45.673519691 156.225931834 -45.673551545 156.226060967 -45.673674035
2021-04-23 15:55:58,293 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 54
2021-04-23 15:55:58,294 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 819
2021-04-23 15:55:58,294 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1305 1319
2021-04-23 15:55:58,397 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:55:58,405 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.225872406 -45.673404272 156.225743296 -45.673281804 156.225681049 -45.673313656 156.225810156 -45.673436124
2021-04-23 15:55:58,405 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.225872406 -45.673404272 156.225743296 -45.673281804 156.225681049 -45.673313656 156.225810156 -45.673436124
2021-04-23 15:55:59,221 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 1
2021-04-23 15:55:59,222 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 118 1591
2021-04-23 15:55:59,223 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 33 52
2021-04-23 15:55:59,334 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:55:59,342 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.221266819 -45.630196596 156.221139727 -45.630076839 156.221077689 -45.630108429 156.221204778 -45.630228186
2021-04-23 15:55:59,342 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.221266819 -45.630196596 156.221139727 -45.630076839 156.221077689 -45.630108429 156.221204778 -45.630228186
2021-04-23 15:56:00,637 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 2
2021-04-23 15:56:00,638 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 124 1598
2021-04-23 15:56:00,638 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 331 351
2021-04-23 15:56:00,753 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:56:00,762 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.228476955 -45.637109572 156.228349188 -45.636989367 156.228287022 -45.637020983 156.228414786 -45.637141189
2021-04-23 15:56:00,763 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.228476955 -45.637109572 156.228349188 -45.636989367 156.228287022 -45.637020983 156.228414786 -45.637141189
2021-04-23 15:56:02,026 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 3
2021-04-23 15:56:02,027 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 116 1589
2021-04-23 15:56:02,027 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 54 73
2021-04-23 15:56:02,145 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:56:02,153 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.221674541 -45.630705151 156.221547408 -45.630585366 156.221485363 -45.630616957 156.221612493 -45.630736743
2021-04-23 15:56:02,154 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.221674541 -45.630705151 156.221547408 -45.630585366 156.221485363 -45.630616957 156.221612493 -45.630736743
2021-04-23 15:56:03,076 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 4
2021-04-23 15:56:03,077 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 111 1584
2021-04-23 15:56:03,077 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 160 179
2021-04-23 15:56:03,194 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:56:03,201 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.224010549 -45.633278787 156.223883188 -45.633158845 156.223821102 -45.633190445 156.223948460 -45.633310387
2021-04-23 15:56:03,202 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.224010549 -45.633278787 156.223883188 -45.633158845 156.223821102 -45.633190445 156.223948460 -45.633310387
2021-04-23 15:56:04,643 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 5
2021-04-23 15:56:04,644 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 99 1573
2021-04-23 15:56:04,644 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 306 326
2021-04-23 15:56:04,763 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:56:04,771 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.227084510 -45.636919416 156.226956832 -45.636799245 156.226894691 -45.636830857 156.227022367 -45.636951029
2021-04-23 15:56:04,772 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.227084510 -45.636919416 156.226956832 -45.636799245 156.226894691 -45.636830857 156.227022367 -45.636951029
2021-04-23 15:56:05,584 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 12
2021-04-23 15:56:05,585 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 91 1566
2021-04-23 15:56:05,585 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 483 503
2021-04-23 15:56:05,699 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:56:05,707 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.230998580 -45.641224458 156.230870498 -45.641103991 156.230808285 -45.641135623 156.230936364 -45.641256090
2021-04-23 15:56:05,708 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.230998580 -45.641224458 156.230870498 -45.641103991 156.230808285 -45.641135623 156.230936364 -45.641256090
2021-04-23 15:56:07,017 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 13
2021-04-23 15:56:07,018 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 80 1553
2021-04-23 15:56:07,019 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 94 113
2021-04-23 15:56:07,130 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:56:07,138 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.221461889 -45.632246282 156.221334710 -45.632126430 156.221272668 -45.632158022 156.221399846 -45.632277874
2021-04-23 15:56:07,138 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.221461889 -45.632246282 156.221334710 -45.632126430 156.221272668 -45.632158022 156.221399846 -45.632277874
2021-04-23 15:56:08,417 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 20
2021-04-23 15:56:08,418 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 76 1551
2021-04-23 15:56:08,418 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 750 770
2021-04-23 15:56:08,540 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:56:08,549 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.236828252 -45.647826217 156.236699542 -45.647705266 156.236637217 -45.647736933 156.236765924 -45.647857884
2021-04-23 15:56:08,549 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.236828252 -45.647826217 156.236699542 -45.647705266 156.236637217 -45.647736933 156.236765924 -45.647857884
2021-04-23 15:56:09,416 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 22
2021-04-23 15:56:09,417 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 68 1542
2021-04-23 15:56:09,417 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 644 664
2021-04-23 15:56:09,589 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:56:09,597 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.234035860 -45.645450737 156.233907420 -45.645329977 156.233845148 -45.645361628 156.233973585 -45.645482389
2021-04-23 15:56:09,598 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.234035860 -45.645450737 156.233907420 -45.645329977 156.233845148 -45.645361628 156.233973585 -45.645482389
2021-04-23 15:56:10,945 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 23
2021-04-23 15:56:10,946 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 52 1525
2021-04-23 15:56:10,947 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 115 133
2021-04-23 15:56:11,061 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:56:11,069 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.221012951 -45.633191592 156.220885760 -45.633071703 156.220823726 -45.633103294 156.220950915 -45.633223183
2021-04-23 15:56:11,069 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.221012951 -45.633191592 156.220885760 -45.633071703 156.220823726 -45.633103294 156.220950915 -45.633223183
2021-04-23 15:56:11,887 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 24
2021-04-23 15:56:11,888 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 69 1545
2021-04-23 15:56:11,888 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 785 805
2021-04-23 15:56:12,028 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:56:12,037 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.237444560 -45.648779316 156.237315772 -45.648658296 156.237253434 -45.648689968 156.237382219 -45.648810988
2021-04-23 15:56:12,038 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.237444560 -45.648779316 156.237315772 -45.648658296 156.237253434 -45.648689968 156.237382219 -45.648810988
2021-04-23 15:56:13,383 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 28
2021-04-23 15:56:13,384 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 11 1485
2021-04-23 15:56:13,385 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 660 679
2021-04-23 15:56:13,499 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:56:13,507 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.232517711 -45.646764241 156.232389309 -45.646643431 156.232327062 -45.646675084 156.232455462 -45.646795894
2021-04-23 15:56:13,508 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.232517711 -45.646764241 156.232389309 -45.646643431 156.232327062 -45.646675084 156.232455462 -45.646795894
2021-04-23 15:56:14,826 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 30
2021-04-23 15:56:14,827 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 1457
2021-04-23 15:56:14,827 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 700 719
2021-04-23 15:56:14,941 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:56:14,950 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.232568977 -45.648183467 156.232440513 -45.648062572 156.232378263 -45.648094230 156.232506725 -45.648215126
2021-04-23 15:56:14,950 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.232568977 -45.648183467 156.232440513 -45.648062572 156.232378263 -45.648094230 156.232506725 -45.648215126
2021-04-23 15:56:15,776 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 34
2021-04-23 15:56:15,777 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 1394
2021-04-23 15:56:15,777 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 715 734
2021-04-23 15:56:15,895 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:56:15,904 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.230879662 -45.649585075 156.230751242 -45.649464125 156.230689019 -45.649495787 156.230817437 -45.649616737
2021-04-23 15:56:15,905 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.230879662 -45.649585075 156.230751242 -45.649464125 156.230689019 -45.649495787 156.230817437 -45.649616737
2021-04-23 15:56:17,303 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 36
2021-04-23 15:56:17,304 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 1377
2021-04-23 15:56:17,304 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 449 466
2021-04-23 15:56:17,417 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:56:17,425 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.224033871 -45.643507774 156.223906106 -45.643387302 156.223844011 -45.643418924 156.223971774 -45.643539396
2021-04-23 15:56:17,426 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.224033871 -45.643507774 156.223906106 -45.643387302 156.223844011 -45.643418924 156.223971774 -45.643539396
2021-04-23 15:56:18,253 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 40
2021-04-23 15:56:18,254 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 1343
2021-04-23 15:56:18,255 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 217 234
2021-04-23 15:56:18,362 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:56:18,370 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.217486084 -45.638574970 156.217358883 -45.638454874 156.217296902 -45.638486467 156.217424102 -45.638606563
2021-04-23 15:56:18,371 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.217486084 -45.638574970 156.217358883 -45.638454874 156.217296902 -45.638486467 156.217424102 -45.638606563
2021-04-23 15:56:19,723 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 42
2021-04-23 15:56:19,723 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 1296
2021-04-23 15:56:19,724 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 545 562
2021-04-23 15:56:19,832 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:56:19,840 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.223646010 -45.647128995 156.223518121 -45.647008321 156.223456024 -45.647039957 156.223583911 -45.647160632
2021-04-23 15:56:19,841 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.223646010 -45.647128995 156.223518121 -45.647008321 156.223456024 -45.647039957 156.223583911 -45.647160632
2021-04-23 15:56:20,665 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 43
2021-04-23 15:56:20,666 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 1246
2021-04-23 15:56:20,666 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 414 430
2021-04-23 15:56:20,773 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:56:20,781 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.218966486 -45.644829601 156.218838959 -45.644709141 156.218776943 -45.644740759 156.218904467 -45.644861220
2021-04-23 15:56:20,782 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.218966486 -45.644829601 156.218838959 -45.644709141 156.218776943 -45.644740759 156.218904467 -45.644861220
2021-04-23 15:56:22,140 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 44
2021-04-23 15:56:22,141 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 1246
2021-04-23 15:56:22,141 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 404 420
2021-04-23 15:56:22,248 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:56:22,256 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.218718991 -45.644595818 156.218591488 -45.644475376 156.218529475 -45.644506992 156.218656977 -45.644627436
2021-04-23 15:56:22,256 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.218718991 -45.644595818 156.218591488 -45.644475376 156.218529475 -45.644506992 156.218656977 -45.644627436
2021-04-23 15:56:23,592 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 45
2021-04-23 15:56:23,592 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 1185
2021-04-23 15:56:23,593 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 530 546
2021-04-23 15:56:23,700 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:56:23,709 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.219673020 -45.648613077 156.219545303 -45.648492383 156.219483265 -45.648524021 156.219610979 -45.648644716
2021-04-23 15:56:23,709 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.219673020 -45.648613077 156.219545303 -45.648492383 156.219483265 -45.648524021 156.219610979 -45.648644716
2021-04-23 15:56:24,532 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 46
2021-04-23 15:56:24,532 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 1158
2021-04-23 15:56:24,533 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 202 218
2021-04-23 15:56:24,638 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:56:24,646 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.211127421 -45.641279813 156.211000463 -45.641159678 156.210938572 -45.641191268 156.211065527 -45.641311404
2021-04-23 15:56:24,647 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.211127421 -45.641279813 156.211000463 -45.641159678 156.210938572 -45.641191268 156.211065527 -45.641311404
2021-04-23 15:56:26,058 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 47
2021-04-23 15:56:26,059 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 1091
2021-04-23 15:56:26,059 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 566 581
2021-04-23 15:56:26,166 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:56:26,175 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.217456055 -45.651006881 156.217328370 -45.650886079 156.217266356 -45.650917729 156.217394038 -45.651038531
2021-04-23 15:56:26,176 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.217456055 -45.651006881 156.217328370 -45.650886079 156.217266356 -45.650917729 156.217394038 -45.651038531
2021-04-23 15:56:27,010 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 48
2021-04-23 15:56:27,011 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 1091
2021-04-23 15:56:27,011 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 561 576
2021-04-23 15:56:27,116 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:56:27,124 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.217332149 -45.650889654 156.217204477 -45.650768862 156.217142464 -45.650800511 156.217270135 -45.650921304
2021-04-23 15:56:27,124 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.217332149 -45.650889654 156.217204477 -45.650768862 156.217142464 -45.650800511 156.217270135 -45.650921304
2021-04-23 15:56:28,539 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 49
2021-04-23 15:56:28,540 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 1067
2021-04-23 15:56:28,540 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 632 647
2021-04-23 15:56:28,649 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:56:28,657 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.218210913 -45.652969013 156.218083107 -45.652848076 156.218021073 -45.652879740 156.218148877 -45.653000678
2021-04-23 15:56:28,658 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.218210913 -45.652969013 156.218083107 -45.652848076 156.218021073 -45.652879740 156.218148877 -45.653000678
2021-04-23 15:56:29,485 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 50
2021-04-23 15:56:29,486 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 1048
2021-04-23 15:56:29,486 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 238 253
2021-04-23 15:56:29,591 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:56:29,598 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.208399869 -45.643929179 156.208272959 -45.643808942 156.208211096 -45.643840541 156.208338005 -45.643960778
2021-04-23 15:56:29,599 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.208399869 -45.643929179 156.208272959 -45.643808942 156.208211096 -45.643840541 156.208338005 -45.643960778
2021-04-23 15:56:31,030 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 51
2021-04-23 15:56:31,031 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 1034
2021-04-23 15:56:31,031 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 430 445
2021-04-23 15:56:31,136 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:56:31,144 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.212403238 -45.648718689 156.212275928 -45.648598111 156.212213993 -45.648629742 156.212341301 -45.648750320
2021-04-23 15:56:31,144 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.212403238 -45.648718689 156.212275928 -45.648598111 156.212213993 -45.648629742 156.212341301 -45.648750320
2021-04-23 15:56:31,984 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 52
2021-04-23 15:56:31,985 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 998
2021-04-23 15:56:31,985 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 803 817
2021-04-23 15:56:32,089 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:56:32,096 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.219947139 -45.658234585 156.219819020 -45.658113276 156.219756938 -45.658144979 156.219885055 -45.658266289
2021-04-23 15:56:32,097 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.219947139 -45.658234585 156.219819020 -45.658113276 156.219756938 -45.658144979 156.219885055 -45.658266289
2021-04-23 15:56:33,589 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 55
2021-04-23 15:56:33,589 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 297
2021-04-23 15:56:33,590 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1415 1430
2021-04-23 15:56:33,689 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:56:33,696 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.211226719 -45.684941334 156.211098073 -45.684818233 156.211035880 -45.684850241 156.211164524 -45.684973343
2021-04-23 15:56:33,697 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.211226719 -45.684941334 156.211098073 -45.684818233 156.211035880 -45.684850241 156.211164524 -45.684973343
2021-04-23 15:56:34,514 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 56
2021-04-23 15:56:34,514 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 143
2021-04-23 15:56:34,515 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 768 783
2021-04-23 15:56:34,611 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:56:34,619 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.191122501 -45.671742959 156.190995485 -45.671621176 156.190933579 -45.671653049 156.191060593 -45.671774833
2021-04-23 15:56:34,619 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.191122501 -45.671742959 156.190995485 -45.671621176 156.190933579 -45.671653049 156.191060593 -45.671774833
2021-04-23 15:56:36,052 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 57
2021-04-23 15:56:36,053 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 74
2021-04-23 15:56:36,053 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 354 370
2021-04-23 15:56:36,152 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2021-04-23 15:56:36,160 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.179343124 -45.662963603 156.179216994 -45.662842617 156.179155236 -45.662874401 156.179281365 -45.662995389
2021-04-23 15:56:36,160 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.179343124 -45.662963603 156.179216994 -45.662842617 156.179155236 -45.662874401 156.179281365 -45.662995389
2021-04-23 15:56:37,782 - stpipe.Extract2dStep - INFO - Step Extract2dStep done
2021-04-23 15:56:40,699 - stpipe.SourceTypeStep - INFO - SourceTypeStep instance created.
2021-04-23 15:56:41,319 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep running with args (<MultiSlitModel from mos_g140m_line1_NRS2_uncal.fits>,).
2021-04-23 15:56:41,321 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-04-23 15:56:41,328 - stpipe.SourceTypeStep - INFO - Input EXP_TYPE is NRS_MSASPEC
2021-04-23 15:56:41,329 - stpipe.SourceTypeStep - INFO - source_id=6, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,329 - stpipe.SourceTypeStep - INFO - source_id=7, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,330 - stpipe.SourceTypeStep - INFO - source_id=8, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,330 - stpipe.SourceTypeStep - INFO - source_id=9, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,331 - stpipe.SourceTypeStep - INFO - source_id=10, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,332 - stpipe.SourceTypeStep - INFO - source_id=11, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,332 - stpipe.SourceTypeStep - INFO - source_id=14, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,333 - stpipe.SourceTypeStep - INFO - source_id=15, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,333 - stpipe.SourceTypeStep - INFO - source_id=16, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,334 - stpipe.SourceTypeStep - INFO - source_id=17, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,334 - stpipe.SourceTypeStep - INFO - source_id=18, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,335 - stpipe.SourceTypeStep - INFO - source_id=19, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,335 - stpipe.SourceTypeStep - INFO - source_id=21, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,336 - stpipe.SourceTypeStep - INFO - source_id=25, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,336 - stpipe.SourceTypeStep - INFO - source_id=26, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,337 - stpipe.SourceTypeStep - INFO - source_id=27, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,337 - stpipe.SourceTypeStep - INFO - source_id=29, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,338 - stpipe.SourceTypeStep - INFO - source_id=31, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,338 - stpipe.SourceTypeStep - INFO - source_id=32, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,339 - stpipe.SourceTypeStep - INFO - source_id=33, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,339 - stpipe.SourceTypeStep - INFO - source_id=35, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,339 - stpipe.SourceTypeStep - INFO - source_id=37, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,340 - stpipe.SourceTypeStep - INFO - source_id=38, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,340 - stpipe.SourceTypeStep - INFO - source_id=39, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,341 - stpipe.SourceTypeStep - INFO - source_id=41, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,341 - stpipe.SourceTypeStep - INFO - source_id=53, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,342 - stpipe.SourceTypeStep - INFO - source_id=54, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,342 - stpipe.SourceTypeStep - INFO - source_id=1, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,343 - stpipe.SourceTypeStep - INFO - source_id=2, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,343 - stpipe.SourceTypeStep - INFO - source_id=3, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,344 - stpipe.SourceTypeStep - INFO - source_id=4, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,344 - stpipe.SourceTypeStep - INFO - source_id=5, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,345 - stpipe.SourceTypeStep - INFO - source_id=12, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,345 - stpipe.SourceTypeStep - INFO - source_id=13, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,345 - stpipe.SourceTypeStep - INFO - source_id=20, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,346 - stpipe.SourceTypeStep - INFO - source_id=22, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,346 - stpipe.SourceTypeStep - INFO - source_id=23, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,347 - stpipe.SourceTypeStep - INFO - source_id=24, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,347 - stpipe.SourceTypeStep - INFO - source_id=28, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,348 - stpipe.SourceTypeStep - INFO - source_id=30, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,348 - stpipe.SourceTypeStep - INFO - source_id=34, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,348 - stpipe.SourceTypeStep - INFO - source_id=36, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,349 - stpipe.SourceTypeStep - INFO - source_id=40, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,349 - stpipe.SourceTypeStep - INFO - source_id=42, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,350 - stpipe.SourceTypeStep - INFO - source_id=43, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,350 - stpipe.SourceTypeStep - INFO - source_id=44, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,351 - stpipe.SourceTypeStep - INFO - source_id=45, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,351 - stpipe.SourceTypeStep - INFO - source_id=46, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,351 - stpipe.SourceTypeStep - INFO - source_id=47, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,352 - stpipe.SourceTypeStep - INFO - source_id=48, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,352 - stpipe.SourceTypeStep - INFO - source_id=49, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,353 - stpipe.SourceTypeStep - INFO - source_id=50, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,353 - stpipe.SourceTypeStep - INFO - source_id=51, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,354 - stpipe.SourceTypeStep - INFO - source_id=52, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,354 - stpipe.SourceTypeStep - INFO - source_id=55, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,354 - stpipe.SourceTypeStep - INFO - source_id=56, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,355 - stpipe.SourceTypeStep - INFO - source_id=57, stellarity=0.0000, type=EXTENDED
2021-04-23 15:56:41,355 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep done
2021-04-23 15:56:41,473 - stpipe.WavecorrStep - INFO - WavecorrStep instance created.
2021-04-23 15:56:41,971 - stpipe.WavecorrStep - INFO - Step WavecorrStep running with args (<MultiSlitModel from mos_g140m_line1_NRS2_uncal.fits>,).
2021-04-23 15:56:41,973 - stpipe.WavecorrStep - INFO - Step WavecorrStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-04-23 15:56:42,091 - stpipe.WavecorrStep - INFO - Using WAVECORR reference file /grp/crds/cache/references/jwst/jwst_nirspec_wavecorr_0002.asdf
2021-04-23 15:56:49,558 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 6
2021-04-23 15:56:49,559 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 7
2021-04-23 15:56:49,559 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 8
2021-04-23 15:56:49,560 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 9
2021-04-23 15:56:49,560 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 10
2021-04-23 15:56:49,560 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 11
2021-04-23 15:56:49,560 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 14
2021-04-23 15:56:49,561 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 15
2021-04-23 15:56:49,561 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 16
2021-04-23 15:56:49,561 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 17
2021-04-23 15:56:49,561 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 18
2021-04-23 15:56:49,562 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 19
2021-04-23 15:56:49,562 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 21
2021-04-23 15:56:49,562 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 25
2021-04-23 15:56:49,563 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 26
2021-04-23 15:56:49,563 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 27
2021-04-23 15:56:49,563 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 29
2021-04-23 15:56:49,564 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 31
2021-04-23 15:56:49,565 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 32
2021-04-23 15:56:49,565 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 33
2021-04-23 15:56:49,565 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 35
2021-04-23 15:56:49,565 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 37
2021-04-23 15:56:49,566 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 38
2021-04-23 15:56:49,566 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 39
2021-04-23 15:56:49,566 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 41
2021-04-23 15:56:49,566 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 53
2021-04-23 15:56:49,567 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 54
2021-04-23 15:56:49,567 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 1
2021-04-23 15:56:49,568 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 2
2021-04-23 15:56:49,568 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 3
2021-04-23 15:56:49,568 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 4
2021-04-23 15:56:49,569 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 5
2021-04-23 15:56:49,569 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 12
2021-04-23 15:56:49,569 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 13
2021-04-23 15:56:49,570 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 20
2021-04-23 15:56:49,570 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 22
2021-04-23 15:56:49,570 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 23
2021-04-23 15:56:49,571 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 24
2021-04-23 15:56:49,571 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 28
2021-04-23 15:56:49,571 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 30
2021-04-23 15:56:49,572 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 34
2021-04-23 15:56:49,572 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 36
2021-04-23 15:56:49,572 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 40
2021-04-23 15:56:49,573 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 42
2021-04-23 15:56:49,573 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 43
2021-04-23 15:56:49,573 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 44
2021-04-23 15:56:49,573 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 45
2021-04-23 15:56:49,574 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 46
2021-04-23 15:56:49,574 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 47
2021-04-23 15:56:49,574 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 48
2021-04-23 15:56:49,574 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 49
2021-04-23 15:56:49,575 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 50
2021-04-23 15:56:49,575 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 51
2021-04-23 15:56:49,576 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 52
2021-04-23 15:56:49,576 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 55
2021-04-23 15:56:49,577 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 56
2021-04-23 15:56:49,577 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 57
2021-04-23 15:56:49,578 - stpipe.WavecorrStep - INFO - Step WavecorrStep done
2021-04-23 15:56:49,677 - stpipe.FlatFieldStep - INFO - FlatFieldStep instance created.
2021-04-23 15:56:50,582 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep running with args (<MultiSlitModel from mos_g140m_line1_NRS2_uncal.fits>,).
2021-04-23 15:56:50,587 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': True, 'user_supplied_flat': None, 'inverse': False}
2021-04-23 15:57:04,766 - stpipe.FlatFieldStep - INFO - Working on slit 6
2021-04-23 15:57:06,739 - stpipe.FlatFieldStep - INFO - Working on slit 7
2021-04-23 15:57:08,716 - stpipe.FlatFieldStep - INFO - Working on slit 8
2021-04-23 15:57:10,861 - stpipe.FlatFieldStep - INFO - Working on slit 9
2021-04-23 15:57:13,076 - stpipe.FlatFieldStep - INFO - Working on slit 10
2021-04-23 15:57:15,259 - stpipe.FlatFieldStep - INFO - Working on slit 11
2021-04-23 15:57:17,326 - stpipe.FlatFieldStep - INFO - Working on slit 14
2021-04-23 15:57:19,319 - stpipe.FlatFieldStep - INFO - Working on slit 15
2021-04-23 15:57:21,266 - stpipe.FlatFieldStep - INFO - Working on slit 16
2021-04-23 15:57:23,217 - stpipe.FlatFieldStep - INFO - Working on slit 17
2021-04-23 15:57:25,199 - stpipe.FlatFieldStep - INFO - Working on slit 18
2021-04-23 15:57:27,165 - stpipe.FlatFieldStep - INFO - Working on slit 19
2021-04-23 15:57:29,139 - stpipe.FlatFieldStep - INFO - Working on slit 21
2021-04-23 15:57:31,031 - stpipe.FlatFieldStep - INFO - Working on slit 25
2021-04-23 15:57:33,019 - stpipe.FlatFieldStep - INFO - Working on slit 26
2021-04-23 15:57:34,995 - stpipe.FlatFieldStep - INFO - Working on slit 27
2021-04-23 15:57:36,983 - stpipe.FlatFieldStep - INFO - Working on slit 29
2021-04-23 15:57:38,972 - stpipe.FlatFieldStep - INFO - Working on slit 31
2021-04-23 15:57:40,938 - stpipe.FlatFieldStep - INFO - Working on slit 32
2021-04-23 15:57:42,808 - stpipe.FlatFieldStep - INFO - Working on slit 33
2021-04-23 15:57:44,698 - stpipe.FlatFieldStep - INFO - Working on slit 35
2021-04-23 15:57:46,592 - stpipe.FlatFieldStep - INFO - Working on slit 37
2021-04-23 15:57:48,460 - stpipe.FlatFieldStep - INFO - Working on slit 38
2021-04-23 15:57:50,318 - stpipe.FlatFieldStep - INFO - Working on slit 39
2021-04-23 15:57:52,177 - stpipe.FlatFieldStep - INFO - Working on slit 41
2021-04-23 15:57:54,064 - stpipe.FlatFieldStep - INFO - Working on slit 53
2021-04-23 15:57:55,172 - stpipe.FlatFieldStep - INFO - Working on slit 54
2021-04-23 15:57:56,277 - stpipe.FlatFieldStep - INFO - Working on slit 1
2021-04-23 15:57:58,261 - stpipe.FlatFieldStep - INFO - Working on slit 2
2021-04-23 15:58:00,216 - stpipe.FlatFieldStep - INFO - Working on slit 3
2021-04-23 15:58:02,166 - stpipe.FlatFieldStep - INFO - Working on slit 4
2021-04-23 15:58:04,031 - stpipe.FlatFieldStep - INFO - Working on slit 5
2021-04-23 15:58:06,020 - stpipe.FlatFieldStep - INFO - Working on slit 12
2021-04-23 15:58:07,946 - stpipe.FlatFieldStep - INFO - Working on slit 13
2021-04-23 15:58:09,871 - stpipe.FlatFieldStep - INFO - Working on slit 20
2021-04-23 15:58:11,796 - stpipe.FlatFieldStep - INFO - Working on slit 22
2021-04-23 15:58:14,555 - stpipe.FlatFieldStep - INFO - Working on slit 23
2021-04-23 15:58:16,488 - stpipe.FlatFieldStep - INFO - Working on slit 24
2021-04-23 15:58:18,338 - stpipe.FlatFieldStep - INFO - Working on slit 28
2021-04-23 15:58:20,269 - stpipe.FlatFieldStep - INFO - Working on slit 30
2021-04-23 15:58:22,242 - stpipe.FlatFieldStep - INFO - Working on slit 34
2021-04-23 15:58:24,080 - stpipe.FlatFieldStep - INFO - Working on slit 36
2021-04-23 15:58:25,921 - stpipe.FlatFieldStep - INFO - Working on slit 40
2021-04-23 15:58:27,673 - stpipe.FlatFieldStep - INFO - Working on slit 42
2021-04-23 15:58:29,349 - stpipe.FlatFieldStep - INFO - Working on slit 43
2021-04-23 15:58:30,976 - stpipe.FlatFieldStep - INFO - Working on slit 44
2021-04-23 15:58:32,645 - stpipe.FlatFieldStep - INFO - Working on slit 45
2021-04-23 15:58:34,275 - stpipe.FlatFieldStep - INFO - Working on slit 46
2021-04-23 15:58:35,825 - stpipe.FlatFieldStep - INFO - Working on slit 47
2021-04-23 15:58:37,291 - stpipe.FlatFieldStep - INFO - Working on slit 48
2021-04-23 15:58:38,755 - stpipe.FlatFieldStep - INFO - Working on slit 49
2021-04-23 15:58:40,189 - stpipe.FlatFieldStep - INFO - Working on slit 50
2021-04-23 15:58:41,545 - stpipe.FlatFieldStep - INFO - Working on slit 51
2021-04-23 15:58:42,865 - stpipe.FlatFieldStep - INFO - Working on slit 52
2021-04-23 15:58:44,128 - stpipe.FlatFieldStep - INFO - Working on slit 55
2021-04-23 15:58:44,551 - stpipe.FlatFieldStep - INFO - Working on slit 56
2021-04-23 15:58:44,792 - stpipe.FlatFieldStep - INFO - Working on slit 57
2021-04-23 15:58:55,859 - stpipe.FlatFieldStep - INFO - Saved model in mos_g140m_line1_NRS2_interpolatedflat.fits
2021-04-23 15:58:55,860 - stpipe.FlatFieldStep - INFO - Interpolated flat written to "mos_g140m_line1_NRS2_interpolatedflat.fits".
2021-04-23 15:58:55,861 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep done
Running flat field test for MOS... Filename: mos_g140m_line1_NRS2_interpolatedflat.fits No. Name Ver Type Cards Dimensions Format 0 PRIMARY 1 PrimaryHDU 278 () 1 SCI 1 ImageHDU 14 (1481, 24) float32 2 DQ 1 ImageHDU 11 (1481, 24) int32 (rescales to uint32) 3 ERR 1 ImageHDU 9 (1481, 24) float32 4 WAVELENGTH 1 ImageHDU 9 (1481, 24) float32 5 SCI 2 ImageHDU 14 (1481, 24) float32 6 DQ 2 ImageHDU 11 (1481, 24) int32 (rescales to uint32) 7 ERR 2 ImageHDU 9 (1481, 24) float32 8 WAVELENGTH 2 ImageHDU 9 (1481, 24) float32 9 SCI 3 ImageHDU 14 (1481, 24) float32 10 DQ 3 ImageHDU 11 (1481, 24) int32 (rescales to uint32) 11 ERR 3 ImageHDU 9 (1481, 24) float32 12 WAVELENGTH 3 ImageHDU 9 (1481, 24) float32 13 SCI 4 ImageHDU 14 (1481, 24) float32 14 DQ 4 ImageHDU 11 (1481, 24) int32 (rescales to uint32) 15 ERR 4 ImageHDU 9 (1481, 24) float32 16 WAVELENGTH 4 ImageHDU 9 (1481, 24) float32 17 SCI 5 ImageHDU 14 (1481, 24) float32 18 DQ 5 ImageHDU 11 (1481, 24) int32 (rescales to uint32) 19 ERR 5 ImageHDU 9 (1481, 24) float32 20 WAVELENGTH 5 ImageHDU 9 (1481, 24) float32 21 SCI 6 ImageHDU 14 (1481, 24) float32 22 DQ 6 ImageHDU 11 (1481, 24) int32 (rescales to uint32) 23 ERR 6 ImageHDU 9 (1481, 24) float32 24 WAVELENGTH 6 ImageHDU 9 (1481, 24) float32 25 SCI 7 ImageHDU 14 (1478, 22) float32 26 DQ 7 ImageHDU 11 (1478, 22) int32 (rescales to uint32) 27 ERR 7 ImageHDU 9 (1478, 22) float32 28 WAVELENGTH 7 ImageHDU 9 (1478, 22) float32 29 SCI 8 ImageHDU 14 (1482, 24) float32 30 DQ 8 ImageHDU 11 (1482, 24) int32 (rescales to uint32) 31 ERR 8 ImageHDU 9 (1482, 24) float32 32 WAVELENGTH 8 ImageHDU 9 (1482, 24) float32 33 SCI 9 ImageHDU 14 (1481, 24) float32 34 DQ 9 ImageHDU 11 (1481, 24) int32 (rescales to uint32) 35 ERR 9 ImageHDU 9 (1481, 24) float32 36 WAVELENGTH 9 ImageHDU 9 (1481, 24) float32 37 SCI 10 ImageHDU 14 (1482, 24) float32 38 DQ 10 ImageHDU 11 (1482, 24) int32 (rescales to uint32) 39 ERR 10 ImageHDU 9 (1482, 24) float32 40 WAVELENGTH 10 ImageHDU 9 (1482, 24) float32 41 SCI 11 ImageHDU 14 (1482, 24) float32 42 DQ 11 ImageHDU 11 (1482, 24) int32 (rescales to uint32) 43 ERR 11 ImageHDU 9 (1482, 24) float32 44 WAVELENGTH 11 ImageHDU 9 (1482, 24) float32 45 SCI 12 ImageHDU 14 (1478, 22) float32 46 DQ 12 ImageHDU 11 (1478, 22) int32 (rescales to uint32) 47 ERR 12 ImageHDU 9 (1478, 22) float32 48 WAVELENGTH 12 ImageHDU 9 (1478, 22) float32 49 SCI 13 ImageHDU 14 (1479, 22) float32 50 DQ 13 ImageHDU 11 (1479, 22) int32 (rescales to uint32) 51 ERR 13 ImageHDU 9 (1479, 22) float32 52 WAVELENGTH 13 ImageHDU 9 (1479, 22) float32 53 SCI 14 ImageHDU 14 (1477, 22) float32 54 DQ 14 ImageHDU 11 (1477, 22) int32 (rescales to uint32) 55 ERR 14 ImageHDU 9 (1477, 22) float32 56 WAVELENGTH 14 ImageHDU 9 (1477, 22) float32 57 SCI 15 ImageHDU 14 (1479, 22) float32 58 DQ 15 ImageHDU 11 (1479, 22) int32 (rescales to uint32) 59 ERR 15 ImageHDU 9 (1479, 22) float32 60 WAVELENGTH 15 ImageHDU 9 (1479, 22) float32 61 SCI 16 ImageHDU 14 (1476, 21) float32 62 DQ 16 ImageHDU 11 (1476, 21) int32 (rescales to uint32) 63 ERR 16 ImageHDU 9 (1476, 21) float32 64 WAVELENGTH 16 ImageHDU 9 (1476, 21) float32 65 SCI 17 ImageHDU 14 (1481, 22) float32 66 DQ 17 ImageHDU 11 (1481, 22) int32 (rescales to uint32) 67 ERR 17 ImageHDU 9 (1481, 22) float32 68 WAVELENGTH 17 ImageHDU 9 (1481, 22) float32 69 SCI 18 ImageHDU 14 (1464, 21) float32 70 DQ 18 ImageHDU 11 (1464, 21) int32 (rescales to uint32) 71 ERR 18 ImageHDU 9 (1464, 21) float32 72 WAVELENGTH 18 ImageHDU 9 (1464, 21) float32 73 SCI 19 ImageHDU 14 (1432, 20) float32 74 DQ 19 ImageHDU 11 (1432, 20) int32 (rescales to uint32) 75 ERR 19 ImageHDU 9 (1432, 20) float32 76 WAVELENGTH 19 ImageHDU 9 (1432, 20) float32 77 SCI 20 ImageHDU 14 (1418, 20) float32 78 DQ 20 ImageHDU 11 (1418, 20) int32 (rescales to uint32) 79 ERR 20 ImageHDU 9 (1418, 20) float32 80 WAVELENGTH 20 ImageHDU 9 (1418, 20) float32 81 SCI 21 ImageHDU 14 (1428, 21) float32 82 DQ 21 ImageHDU 11 (1428, 21) int32 (rescales to uint32) 83 ERR 21 ImageHDU 9 (1428, 21) float32 84 WAVELENGTH 21 ImageHDU 9 (1428, 21) float32 85 SCI 22 ImageHDU 14 (1412, 20) float32 86 DQ 22 ImageHDU 11 (1412, 20) int32 (rescales to uint32) 87 ERR 22 ImageHDU 9 (1412, 20) float32 88 WAVELENGTH 22 ImageHDU 9 (1412, 20) float32 89 SCI 23 ImageHDU 14 (1404, 20) float32 90 DQ 23 ImageHDU 11 (1404, 20) int32 (rescales to uint32) 91 ERR 23 ImageHDU 9 (1404, 20) float32 92 WAVELENGTH 23 ImageHDU 9 (1404, 20) float32 93 SCI 24 ImageHDU 14 (1385, 20) float32 94 DQ 24 ImageHDU 11 (1385, 20) int32 (rescales to uint32) 95 ERR 24 ImageHDU 9 (1385, 20) float32 96 WAVELENGTH 24 ImageHDU 9 (1385, 20) float32 97 SCI 25 ImageHDU 14 (1393, 20) float32 98 DQ 25 ImageHDU 11 (1393, 20) int32 (rescales to uint32) 99 ERR 25 ImageHDU 9 (1393, 20) float32 100 WAVELENGTH 25 ImageHDU 9 (1393, 20) float32 101 SCI 26 ImageHDU 14 (819, 14) float32 102 DQ 26 ImageHDU 11 (819, 14) int32 (rescales to uint32) 103 ERR 26 ImageHDU 9 (819, 14) float32 104 WAVELENGTH 26 ImageHDU 9 (819, 14) float32 105 SCI 27 ImageHDU 14 (819, 14) float32 106 DQ 27 ImageHDU 11 (819, 14) int32 (rescales to uint32) 107 ERR 27 ImageHDU 9 (819, 14) float32 108 WAVELENGTH 27 ImageHDU 9 (819, 14) float32 109 SCI 28 ImageHDU 14 (1473, 19) float32 110 DQ 28 ImageHDU 11 (1473, 19) int32 (rescales to uint32) 111 ERR 28 ImageHDU 9 (1473, 19) float32 112 WAVELENGTH 28 ImageHDU 9 (1473, 19) float32 113 SCI 29 ImageHDU 14 (1474, 20) float32 114 DQ 29 ImageHDU 11 (1474, 20) int32 (rescales to uint32) 115 ERR 29 ImageHDU 9 (1474, 20) float32 116 WAVELENGTH 29 ImageHDU 9 (1474, 20) float32 117 SCI 30 ImageHDU 14 (1473, 19) float32 118 DQ 30 ImageHDU 11 (1473, 19) int32 (rescales to uint32) 119 ERR 30 ImageHDU 9 (1473, 19) float32 120 WAVELENGTH 30 ImageHDU 9 (1473, 19) float32 121 SCI 31 ImageHDU 14 (1473, 19) float32 122 DQ 31 ImageHDU 11 (1473, 19) int32 (rescales to uint32) 123 ERR 31 ImageHDU 9 (1473, 19) float32 124 WAVELENGTH 31 ImageHDU 9 (1473, 19) float32 125 SCI 32 ImageHDU 14 (1474, 20) float32 126 DQ 32 ImageHDU 11 (1474, 20) int32 (rescales to uint32) 127 ERR 32 ImageHDU 9 (1474, 20) float32 128 WAVELENGTH 32 ImageHDU 9 (1474, 20) float32 129 SCI 33 ImageHDU 14 (1475, 20) float32 130 DQ 33 ImageHDU 11 (1475, 20) int32 (rescales to uint32) 131 ERR 33 ImageHDU 9 (1475, 20) float32 132 WAVELENGTH 33 ImageHDU 9 (1475, 20) float32 133 SCI 34 ImageHDU 14 (1473, 19) float32 134 DQ 34 ImageHDU 11 (1473, 19) int32 (rescales to uint32) 135 ERR 34 ImageHDU 9 (1473, 19) float32 136 WAVELENGTH 34 ImageHDU 9 (1473, 19) float32 137 SCI 35 ImageHDU 14 (1475, 20) float32 138 DQ 35 ImageHDU 11 (1475, 20) int32 (rescales to uint32) 139 ERR 35 ImageHDU 9 (1475, 20) float32 140 WAVELENGTH 35 ImageHDU 9 (1475, 20) float32 141 SCI 36 ImageHDU 14 (1474, 20) float32 142 DQ 36 ImageHDU 11 (1474, 20) int32 (rescales to uint32) 143 ERR 36 ImageHDU 9 (1474, 20) float32 144 WAVELENGTH 36 ImageHDU 9 (1474, 20) float32 145 SCI 37 ImageHDU 14 (1473, 18) float32 146 DQ 37 ImageHDU 11 (1473, 18) int32 (rescales to uint32) 147 ERR 37 ImageHDU 9 (1473, 18) float32 148 WAVELENGTH 37 ImageHDU 9 (1473, 18) float32 149 SCI 38 ImageHDU 14 (1476, 20) float32 150 DQ 38 ImageHDU 11 (1476, 20) int32 (rescales to uint32) 151 ERR 38 ImageHDU 9 (1476, 20) float32 152 WAVELENGTH 38 ImageHDU 9 (1476, 20) float32 153 SCI 39 ImageHDU 14 (1474, 19) float32 154 DQ 39 ImageHDU 11 (1474, 19) int32 (rescales to uint32) 155 ERR 39 ImageHDU 9 (1474, 19) float32 156 WAVELENGTH 39 ImageHDU 9 (1474, 19) float32 157 SCI 40 ImageHDU 14 (1457, 19) float32 158 DQ 40 ImageHDU 11 (1457, 19) int32 (rescales to uint32) 159 ERR 40 ImageHDU 9 (1457, 19) float32 160 WAVELENGTH 40 ImageHDU 9 (1457, 19) float32 161 SCI 41 ImageHDU 14 (1394, 19) float32 162 DQ 41 ImageHDU 11 (1394, 19) int32 (rescales to uint32) 163 ERR 41 ImageHDU 9 (1394, 19) float32 164 WAVELENGTH 41 ImageHDU 9 (1394, 19) float32 165 SCI 42 ImageHDU 14 (1377, 17) float32 166 DQ 42 ImageHDU 11 (1377, 17) int32 (rescales to uint32) 167 ERR 42 ImageHDU 9 (1377, 17) float32 168 WAVELENGTH 42 ImageHDU 9 (1377, 17) float32 169 SCI 43 ImageHDU 14 (1343, 17) float32 170 DQ 43 ImageHDU 11 (1343, 17) int32 (rescales to uint32) 171 ERR 43 ImageHDU 9 (1343, 17) float32 172 WAVELENGTH 43 ImageHDU 9 (1343, 17) float32 173 SCI 44 ImageHDU 14 (1296, 17) float32 174 DQ 44 ImageHDU 11 (1296, 17) int32 (rescales to uint32) 175 ERR 44 ImageHDU 9 (1296, 17) float32 176 WAVELENGTH 44 ImageHDU 9 (1296, 17) float32 177 SCI 45 ImageHDU 14 (1246, 16) float32 178 DQ 45 ImageHDU 11 (1246, 16) int32 (rescales to uint32) 179 ERR 45 ImageHDU 9 (1246, 16) float32 180 WAVELENGTH 45 ImageHDU 9 (1246, 16) float32 181 SCI 46 ImageHDU 14 (1246, 16) float32 182 DQ 46 ImageHDU 11 (1246, 16) int32 (rescales to uint32) 183 ERR 46 ImageHDU 9 (1246, 16) float32 184 WAVELENGTH 46 ImageHDU 9 (1246, 16) float32 185 SCI 47 ImageHDU 14 (1185, 16) float32 186 DQ 47 ImageHDU 11 (1185, 16) int32 (rescales to uint32) 187 ERR 47 ImageHDU 9 (1185, 16) float32 188 WAVELENGTH 47 ImageHDU 9 (1185, 16) float32 189 SCI 48 ImageHDU 14 (1158, 16) float32 190 DQ 48 ImageHDU 11 (1158, 16) int32 (rescales to uint32) 191 ERR 48 ImageHDU 9 (1158, 16) float32 192 WAVELENGTH 48 ImageHDU 9 (1158, 16) float32 193 SCI 49 ImageHDU 14 (1091, 15) float32 194 DQ 49 ImageHDU 11 (1091, 15) int32 (rescales to uint32) 195 ERR 49 ImageHDU 9 (1091, 15) float32 196 WAVELENGTH 49 ImageHDU 9 (1091, 15) float32 197 SCI 50 ImageHDU 14 (1091, 15) float32 198 DQ 50 ImageHDU 11 (1091, 15) int32 (rescales to uint32) 199 ERR 50 ImageHDU 9 (1091, 15) float32 200 WAVELENGTH 50 ImageHDU 9 (1091, 15) float32 201 SCI 51 ImageHDU 14 (1067, 15) float32 202 DQ 51 ImageHDU 11 (1067, 15) int32 (rescales to uint32) 203 ERR 51 ImageHDU 9 (1067, 15) float32 204 WAVELENGTH 51 ImageHDU 9 (1067, 15) float32 205 SCI 52 ImageHDU 14 (1048, 15) float32 206 DQ 52 ImageHDU 11 (1048, 15) int32 (rescales to uint32) 207 ERR 52 ImageHDU 9 (1048, 15) float32 208 WAVELENGTH 52 ImageHDU 9 (1048, 15) float32 209 SCI 53 ImageHDU 14 (1034, 15) float32 210 DQ 53 ImageHDU 11 (1034, 15) int32 (rescales to uint32) 211 ERR 53 ImageHDU 9 (1034, 15) float32 212 WAVELENGTH 53 ImageHDU 9 (1034, 15) float32 213 SCI 54 ImageHDU 14 (998, 14) float32 214 DQ 54 ImageHDU 11 (998, 14) int32 (rescales to uint32) 215 ERR 54 ImageHDU 9 (998, 14) float32 216 WAVELENGTH 54 ImageHDU 9 (998, 14) float32 217 SCI 55 ImageHDU 14 (297, 15) float32 218 DQ 55 ImageHDU 11 (297, 15) int32 (rescales to uint32) 219 ERR 55 ImageHDU 9 (297, 15) float32 220 WAVELENGTH 55 ImageHDU 9 (297, 15) float32 221 SCI 56 ImageHDU 14 (143, 15) float32 222 DQ 56 ImageHDU 11 (143, 15) int32 (rescales to uint32) 223 ERR 56 ImageHDU 9 (143, 15) float32 224 WAVELENGTH 56 ImageHDU 9 (143, 15) float32 225 SCI 57 ImageHDU 14 (74, 16) float32 226 DQ 57 ImageHDU 11 (74, 16) int32 (rescales to uint32) 227 ERR 57 ImageHDU 9 (74, 16) float32 228 WAVELENGTH 57 ImageHDU 9 (74, 16) float32 229 ASDF 1 BinTableHDU 11 1R x 1C [3143179B] flat_field_file --> Grating:G140M Filter:F100LP LAMP:LINE1 Using D-flat: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_dflat_nrs2_f_01.03.fits Using S-flat: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_MOS_sflat_G140M_OPAQUE_FLAT1_nrs2_f_01.01.fits Using F-flat: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_MOS_fflat_F100LP_01.01.fits Working with slit: 6 Subwindow origin: px0=139 py0=1762 silt_id='6' quad=1 row=33 col=54 slitlet_id='33_54' Now looping through the pixels, this will take a while ...
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/gwcs/geometry.py:203: RuntimeWarning: invalid value encountered in remainder lon = np.mod(lon, 360.0 * u.deg if nquant else 360.0) /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/nirspec_pipe_testing_tool/calwebb_spec2_pytests/auxiliary_code/flattest_mos.py:527: RuntimeWarning: invalid value encountered in true_divide sff = int_tab/(last_sfv_wav - first_sfv_wav)
Calculating statistics...
Absolute Flat Difference : mean = -1.167e-06 median = -1.709e-07 stdev = 2.294e-04
Maximum AbsoluteFlat Difference = 3.117e-03
Minimum AbsoluteFlat Difference = -2.870e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 34%
-> 3xtheshold = 7%
-> 5xtheshold = 3%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 7
Subwindow origin: px0=139 py0=1757
silt_id='7' quad=1 row=33 col=55 slitlet_id='33_55'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = -3.743e-08 median = -9.123e-08 stdev = 2.303e-04
Maximum AbsoluteFlat Difference = 3.098e-03
Minimum AbsoluteFlat Difference = -3.014e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 33%
-> 3xtheshold = 7%
-> 5xtheshold = 3%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 8
Subwindow origin: px0=138 py0=1807
silt_id='8' quad=1 row=34 col=45 slitlet_id='34_45'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = -1.338e-06 median = 3.717e-07 stdev = 2.276e-04
Maximum AbsoluteFlat Difference = 2.700e-03
Minimum AbsoluteFlat Difference = -3.050e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 34%
-> 3xtheshold = 7%
-> 5xtheshold = 3%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 9
Subwindow origin: px0=138 py0=1802
silt_id='9' quad=1 row=34 col=46 slitlet_id='34_46'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = -3.124e-07 median = 4.085e-07 stdev = 2.297e-04
Maximum AbsoluteFlat Difference = 3.185e-03
Minimum AbsoluteFlat Difference = -3.028e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 34%
-> 3xtheshold = 7%
-> 5xtheshold = 3%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 10
Subwindow origin: px0=138 py0=1797
silt_id='10' quad=1 row=34 col=47 slitlet_id='34_47'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = -9.601e-07 median = -4.138e-07 stdev = 2.273e-04
Maximum AbsoluteFlat Difference = 3.207e-03
Minimum AbsoluteFlat Difference = -2.875e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 34%
-> 3xtheshold = 7%
-> 5xtheshold = 3%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 11
Subwindow origin: px0=137 py0=1837
silt_id='11' quad=1 row=35 col=39 slitlet_id='35_39'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = -2.213e-06 median = -4.741e-07 stdev = 2.311e-04
Maximum AbsoluteFlat Difference = 2.901e-03
Minimum AbsoluteFlat Difference = -3.010e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 34%
-> 3xtheshold = 7%
-> 5xtheshold = 3%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 14
Subwindow origin: px0=105 py0=1222
silt_id='14' quad=1 row=38 col=162 slitlet_id='38_162'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = -1.446e-06 median = -8.468e-08 stdev = 2.325e-04
Maximum AbsoluteFlat Difference = 2.871e-03
Minimum AbsoluteFlat Difference = -3.460e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 35%
-> 3xtheshold = 7%
-> 5xtheshold = 3%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 15
Subwindow origin: px0=123 py0=1887
silt_id='15' quad=1 row=41 col=29 slitlet_id='41_29'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = -1.315e-06 median = -7.164e-07 stdev = 2.289e-04
Maximum AbsoluteFlat Difference = 2.885e-03
Minimum AbsoluteFlat Difference = -2.702e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 34%
-> 3xtheshold = 7%
-> 5xtheshold = 3%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 16
Subwindow origin: px0=118 py0=1822
silt_id='16' quad=1 row=42 col=42 slitlet_id='42_42'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = 9.928e-07 median = -1.701e-07 stdev = 2.328e-04
Maximum AbsoluteFlat Difference = 3.084e-03
Minimum AbsoluteFlat Difference = -2.990e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 34%
-> 3xtheshold = 7%
-> 5xtheshold = 3%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 17
Subwindow origin: px0=116 py0=1852
silt_id='17' quad=1 row=43 col=36 slitlet_id='43_36'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = 7.200e-07 median = 1.147e-07 stdev = 2.303e-04
Maximum AbsoluteFlat Difference = 3.146e-03
Minimum AbsoluteFlat Difference = -3.234e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 34%
-> 3xtheshold = 7%
-> 5xtheshold = 3%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 18
Subwindow origin: px0=116 py0=1847
silt_id='18' quad=1 row=43 col=37 slitlet_id='43_37'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = 1.306e-06 median = 1.028e-07 stdev = 2.315e-04
Maximum AbsoluteFlat Difference = 3.241e-03
Minimum AbsoluteFlat Difference = -3.340e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 34%
-> 3xtheshold = 7%
-> 5xtheshold = 3%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 19
Subwindow origin: px0=94 py0=1337
silt_id='19' quad=1 row=44 col=139 slitlet_id='44_139'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = 6.611e-07 median = -1.314e-06 stdev = 2.356e-04
Maximum AbsoluteFlat Difference = 3.085e-03
Minimum AbsoluteFlat Difference = -3.124e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 35%
-> 3xtheshold = 7%
-> 5xtheshold = 3%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 21
Subwindow origin: px0=90 py0=1382
silt_id='21' quad=1 row=46 col=130 slitlet_id='46_130'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = 2.481e-07 median = -1.187e-08 stdev = 2.432e-04
Maximum AbsoluteFlat Difference = 2.855e-03
Minimum AbsoluteFlat Difference = -3.016e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 35%
-> 3xtheshold = 7%
-> 5xtheshold = 3%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 25
Subwindow origin: px0=71 py0=1277
silt_id='25' quad=1 row=52 col=151 slitlet_id='52_151'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = -6.818e-07 median = -3.924e-07 stdev = 2.463e-04
Maximum AbsoluteFlat Difference = 3.495e-03
Minimum AbsoluteFlat Difference = -2.885e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 35%
-> 3xtheshold = 7%
-> 5xtheshold = 3%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 26
Subwindow origin: px0=66 py0=1563
silt_id='26' quad=1 row=58 col=94 slitlet_id='58_94'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = -5.225e-07 median = -3.652e-07 stdev = 2.295e-04
Maximum AbsoluteFlat Difference = 3.283e-03
Minimum AbsoluteFlat Difference = -3.066e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 34%
-> 3xtheshold = 7%
-> 5xtheshold = 3%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 27
Subwindow origin: px0=32 py0=1202
silt_id='27' quad=1 row=66 col=166 slitlet_id='66_166'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = -8.344e-08 median = 1.772e-07 stdev = 2.459e-04
Maximum AbsoluteFlat Difference = 2.915e-03
Minimum AbsoluteFlat Difference = -3.321e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 34%
-> 3xtheshold = 7%
-> 5xtheshold = 3%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 29
Subwindow origin: px0=23 py0=1868
silt_id='29' quad=1 row=79 col=33 slitlet_id='79_33'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = 2.951e-08 median = -1.362e-07 stdev = 2.354e-04
Maximum AbsoluteFlat Difference = 3.288e-03
Minimum AbsoluteFlat Difference = -2.885e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 34%
-> 3xtheshold = 7%
-> 5xtheshold = 3%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 31
Subwindow origin: px0=1 py0=1368
silt_id='31' quad=1 row=85 col=133 slitlet_id='85_133'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = -2.496e-06 median = -6.532e-07 stdev = 2.336e-04
Maximum AbsoluteFlat Difference = 3.134e-03
Minimum AbsoluteFlat Difference = -3.286e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 34%
-> 3xtheshold = 7%
-> 5xtheshold = 3%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 32
Subwindow origin: px0=1 py0=1353
silt_id='32' quad=1 row=97 col=136 slitlet_id='97_136'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = -1.366e-06 median = -1.967e-07 stdev = 1.540e-04
Maximum AbsoluteFlat Difference = 1.041e-03
Minimum AbsoluteFlat Difference = -1.045e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 34%
-> 3xtheshold = 6%
-> 5xtheshold = 2%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 33
Subwindow origin: px0=1 py0=1273
silt_id='33' quad=1 row=101 col=152 slitlet_id='101_152'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = 8.870e-07 median = -4.690e-07 stdev = 1.473e-04
Maximum AbsoluteFlat Difference = 1.200e-03
Minimum AbsoluteFlat Difference = -9.525e-04
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 33%
-> 3xtheshold = 5%
-> 5xtheshold = 1%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 35
Subwindow origin: px0=1 py0=1723
silt_id='35' quad=1 row=105 col=62 slitlet_id='105_62'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = 7.044e-07 median = 8.524e-07 stdev = 1.477e-04
Maximum AbsoluteFlat Difference = 9.801e-04
Minimum AbsoluteFlat Difference = -1.112e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 33%
-> 3xtheshold = 6%
-> 5xtheshold = 1%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 37
Subwindow origin: px0=1 py0=1664
silt_id='37' quad=1 row=110 col=74 slitlet_id='110_74'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = -1.034e-06 median = -1.265e-06 stdev = 1.443e-04
Maximum AbsoluteFlat Difference = 1.144e-03
Minimum AbsoluteFlat Difference = -1.080e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 33%
-> 3xtheshold = 5%
-> 5xtheshold = 1%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 38
Subwindow origin: px0=1 py0=1604
silt_id='38' quad=1 row=112 col=86 slitlet_id='112_86'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = 2.665e-09 median = 9.843e-09 stdev = 1.450e-04
Maximum AbsoluteFlat Difference = 1.370e-03
Minimum AbsoluteFlat Difference = -1.258e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 33%
-> 3xtheshold = 5%
-> 5xtheshold = 1%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 39
Subwindow origin: px0=1 py0=1243
silt_id='39' quad=1 row=113 col=158 slitlet_id='113_158'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = 9.458e-07 median = 3.551e-07 stdev = 1.468e-04
Maximum AbsoluteFlat Difference = 1.172e-03
Minimum AbsoluteFlat Difference = -1.266e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 33%
-> 3xtheshold = 5%
-> 5xtheshold = 1%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 41
Subwindow origin: px0=1 py0=1769
silt_id='41' quad=1 row=119 col=53 slitlet_id='119_53'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = 7.015e-07 median = 3.791e-08 stdev = 1.407e-04
Maximum AbsoluteFlat Difference = 1.066e-03
Minimum AbsoluteFlat Difference = -1.040e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 32%
-> 3xtheshold = 5%
-> 5xtheshold = 1%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 53
Subwindow origin: px0=1 py0=1316
silt_id='53' quad=1 row=330 col=144 slitlet_id='330_144'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = 1.052e-06 median = 6.678e-07 stdev = 9.442e-05
Maximum AbsoluteFlat Difference = 4.570e-04
Minimum AbsoluteFlat Difference = -4.506e-04
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 22%
-> 3xtheshold = 1%
-> 5xtheshold = 0%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 54
Subwindow origin: px0=1 py0=1306
silt_id='54' quad=1 row=330 col=146 slitlet_id='330_146'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = 2.538e-07 median = -9.270e-08 stdev = 9.233e-05
Maximum AbsoluteFlat Difference = 5.143e-04
Minimum AbsoluteFlat Difference = -4.542e-04
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 21%
-> 3xtheshold = 1%
-> 5xtheshold = 0%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 1
Subwindow origin: px0=119 py0=34
silt_id='1' quad=2 row=20 col=157 slitlet_id='20_157'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = -1.460e-06 median = -4.517e-07 stdev = 2.291e-04
Maximum AbsoluteFlat Difference = 2.774e-03
Minimum AbsoluteFlat Difference = -3.272e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 34%
-> 3xtheshold = 6%
-> 5xtheshold = 3%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 2
Subwindow origin: px0=125 py0=332
silt_id='2' quad=2 row=21 col=98 slitlet_id='21_98'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = 1.653e-06 median = 3.920e-07 stdev = 2.247e-04
Maximum AbsoluteFlat Difference = 2.564e-03
Minimum AbsoluteFlat Difference = -2.500e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 33%
-> 3xtheshold = 7%
-> 5xtheshold = 3%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 3
Subwindow origin: px0=117 py0=55
silt_id='3' quad=2 row=21 col=153 slitlet_id='21_153'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = -1.952e-06 median = -7.805e-07 stdev = 2.169e-04
Maximum AbsoluteFlat Difference = 3.148e-03
Minimum AbsoluteFlat Difference = -3.153e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 33%
-> 3xtheshold = 6%
-> 5xtheshold = 2%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 4
Subwindow origin: px0=112 py0=161
silt_id='4' quad=2 row=24 col=132 slitlet_id='24_132'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = -1.874e-06 median = -2.281e-07 stdev = 2.161e-04
Maximum AbsoluteFlat Difference = 3.042e-03
Minimum AbsoluteFlat Difference = -3.084e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 33%
-> 3xtheshold = 6%
-> 5xtheshold = 2%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 5
Subwindow origin: px0=100 py0=307
silt_id='5' quad=2 row=30 col=103 slitlet_id='30_103'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = 9.283e-07 median = 6.648e-07 stdev = 2.249e-04
Maximum AbsoluteFlat Difference = 2.944e-03
Minimum AbsoluteFlat Difference = -2.999e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 33%
-> 3xtheshold = 6%
-> 5xtheshold = 3%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 12
Subwindow origin: px0=92 py0=484
silt_id='12' quad=2 row=35 col=68 slitlet_id='35_68'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = -1.230e-06 median = -4.578e-07 stdev = 2.164e-04
Maximum AbsoluteFlat Difference = 2.994e-03
Minimum AbsoluteFlat Difference = -2.829e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 33%
-> 3xtheshold = 6%
-> 5xtheshold = 2%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 13
Subwindow origin: px0=81 py0=95
silt_id='13' quad=2 row=35 col=145 slitlet_id='35_145'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = 6.295e-07 median = 3.614e-07 stdev = 2.217e-04
Maximum AbsoluteFlat Difference = 3.348e-03
Minimum AbsoluteFlat Difference = -3.281e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 34%
-> 3xtheshold = 7%
-> 5xtheshold = 3%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 20
Subwindow origin: px0=77 py0=751
silt_id='20' quad=2 row=44 col=15 slitlet_id='44_15'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = 3.679e-07 median = 1.707e-07 stdev = 2.210e-04
Maximum AbsoluteFlat Difference = 2.920e-03
Minimum AbsoluteFlat Difference = -2.975e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 34%
-> 3xtheshold = 7%
-> 5xtheshold = 3%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 22
Subwindow origin: px0=69 py0=645
silt_id='22' quad=2 row=46 col=36 slitlet_id='46_36'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = 6.708e-08 median = 1.166e-07 stdev = 2.220e-04
Maximum AbsoluteFlat Difference = 3.033e-03
Minimum AbsoluteFlat Difference = -3.126e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 34%
-> 3xtheshold = 7%
-> 5xtheshold = 2%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 23
Subwindow origin: px0=53 py0=116
silt_id='23' quad=2 row=46 col=141 slitlet_id='46_141'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = -3.925e-08 median = 2.818e-07 stdev = 2.170e-04
Maximum AbsoluteFlat Difference = 3.060e-03
Minimum AbsoluteFlat Difference = -2.956e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 34%
-> 3xtheshold = 6%
-> 5xtheshold = 2%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 24
Subwindow origin: px0=70 py0=786
silt_id='24' quad=2 row=47 col=8 slitlet_id='47_8'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = -4.871e-07 median = -4.722e-07 stdev = 2.219e-04
Maximum AbsoluteFlat Difference = 3.614e-03
Minimum AbsoluteFlat Difference = -3.106e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 33%
-> 3xtheshold = 6%
-> 5xtheshold = 2%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 28
Subwindow origin: px0=12 py0=661
silt_id='28' quad=2 row=68 col=33 slitlet_id='68_33'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = 4.190e-07 median = 1.081e-06 stdev = 2.242e-04
Maximum AbsoluteFlat Difference = 3.226e-03
Minimum AbsoluteFlat Difference = -3.083e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 34%
-> 3xtheshold = 7%
-> 5xtheshold = 2%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 30
Subwindow origin: px0=1 py0=701
silt_id='30' quad=2 row=79 col=25 slitlet_id='79_25'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = -9.394e-07 median = 7.435e-08 stdev = 2.173e-04
Maximum AbsoluteFlat Difference = 3.161e-03
Minimum AbsoluteFlat Difference = -3.211e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 34%
-> 3xtheshold = 6%
-> 5xtheshold = 2%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 34
Subwindow origin: px0=1 py0=716
silt_id='34' quad=2 row=103 col=22 slitlet_id='103_22'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = -1.708e-06 median = -6.923e-07 stdev = 1.403e-04
Maximum AbsoluteFlat Difference = 1.127e-03
Minimum AbsoluteFlat Difference = -1.185e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 32%
-> 3xtheshold = 5%
-> 5xtheshold = 1%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 36
Subwindow origin: px0=1 py0=450
silt_id='36' quad=2 row=106 col=75 slitlet_id='106_75'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = -2.510e-07 median = -5.203e-07 stdev = 1.326e-04
Maximum AbsoluteFlat Difference = 7.893e-04
Minimum AbsoluteFlat Difference = -9.772e-04
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 31%
-> 3xtheshold = 4%
-> 5xtheshold = 1%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 40
Subwindow origin: px0=1 py0=218
silt_id='40' quad=2 row=116 col=121 slitlet_id='116_121'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = -5.100e-07 median = -1.208e-06 stdev = 1.308e-04
Maximum AbsoluteFlat Difference = 9.625e-04
Minimum AbsoluteFlat Difference = -7.700e-04
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 30%
-> 3xtheshold = 4%
-> 5xtheshold = 1%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 42
Subwindow origin: px0=1 py0=546
silt_id='42' quad=2 row=138 col=56 slitlet_id='138_56'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = 2.014e-06 median = -4.196e-07 stdev = 1.234e-04
Maximum AbsoluteFlat Difference = 1.066e-03
Minimum AbsoluteFlat Difference = -8.083e-04
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 29%
-> 3xtheshold = 3%
-> 5xtheshold = 1%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 43
Subwindow origin: px0=1 py0=415
silt_id='43' quad=2 row=155 col=82 slitlet_id='155_82'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = -2.637e-07 median = 3.676e-07 stdev = 1.159e-04
Maximum AbsoluteFlat Difference = 6.433e-04
Minimum AbsoluteFlat Difference = -7.721e-04
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 28%
-> 3xtheshold = 3%
-> 5xtheshold = 0%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 44
Subwindow origin: px0=1 py0=405
silt_id='44' quad=2 row=155 col=84 slitlet_id='155_84'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = -7.043e-07 median = -4.557e-07 stdev = 1.156e-04
Maximum AbsoluteFlat Difference = 8.535e-04
Minimum AbsoluteFlat Difference = -8.189e-04
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 28%
-> 3xtheshold = 2%
-> 5xtheshold = 0%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 45
Subwindow origin: px0=1 py0=531
silt_id='45' quad=2 row=180 col=59 slitlet_id='180_59'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = -2.508e-07 median = -6.537e-07 stdev = 1.119e-04
Maximum AbsoluteFlat Difference = 7.788e-04
Minimum AbsoluteFlat Difference = -8.520e-04
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 27%
-> 3xtheshold = 2%
-> 5xtheshold = 0%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 46
Subwindow origin: px0=1 py0=203
silt_id='46' quad=2 row=186 col=124 slitlet_id='186_124'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = -1.962e-07 median = 3.201e-07 stdev = 1.076e-04
Maximum AbsoluteFlat Difference = 8.721e-04
Minimum AbsoluteFlat Difference = -7.647e-04
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 27%
-> 3xtheshold = 2%
-> 5xtheshold = 0%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 47
Subwindow origin: px0=1 py0=567
silt_id='47' quad=2 row=216 col=52 slitlet_id='216_52'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = -1.014e-06 median = -5.019e-07 stdev = 1.043e-04
Maximum AbsoluteFlat Difference = 5.653e-04
Minimum AbsoluteFlat Difference = -6.140e-04
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 26%
-> 3xtheshold = 2%
-> 5xtheshold = 0%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 48
Subwindow origin: px0=1 py0=562
silt_id='48' quad=2 row=216 col=53 slitlet_id='216_53'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = 2.653e-07 median = -2.793e-07 stdev = 1.039e-04
Maximum AbsoluteFlat Difference = 5.858e-04
Minimum AbsoluteFlat Difference = -4.755e-04
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 25%
-> 3xtheshold = 2%
-> 5xtheshold = 0%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 49
Subwindow origin: px0=1 py0=633
silt_id='49' quad=2 row=226 col=39 slitlet_id='226_39'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = -1.128e-05 median = -1.805e-07 stdev = 8.076e-04
Maximum AbsoluteFlat Difference = 4.734e-04
Minimum AbsoluteFlat Difference = -5.937e-02
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 25%
-> 3xtheshold = 2%
-> 5xtheshold = 0%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 50
Subwindow origin: px0=1 py0=239
silt_id='50' quad=2 row=228 col=117 slitlet_id='228_117'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = -7.065e-07 median = -8.914e-08 stdev = 1.028e-04
Maximum AbsoluteFlat Difference = 4.845e-04
Minimum AbsoluteFlat Difference = -5.073e-04
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 25%
-> 3xtheshold = 2%
-> 5xtheshold = 0%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 51
Subwindow origin: px0=1 py0=431
silt_id='51' quad=2 row=236 col=79 slitlet_id='236_79'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = -1.565e-07 median = -6.203e-07 stdev = 1.024e-04
Maximum AbsoluteFlat Difference = 5.441e-04
Minimum AbsoluteFlat Difference = -5.250e-04
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 25%
-> 3xtheshold = 2%
-> 5xtheshold = 0%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 52
Subwindow origin: px0=1 py0=804
silt_id='52' quad=2 row=255 col=5 slitlet_id='255_5'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = 1.208e-06 median = -7.420e-07 stdev = 1.012e-04
Maximum AbsoluteFlat Difference = 6.290e-04
Minimum AbsoluteFlat Difference = -6.241e-04
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 25%
-> 3xtheshold = 1%
-> 5xtheshold = 0%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 55
Subwindow origin: px0=1 py0=1416
silt_id='55' quad=3 row=82 col=124 slitlet_id='82_124'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = -3.714e-07 median = -4.575e-08 stdev = 6.297e-05
Maximum AbsoluteFlat Difference = 3.558e-04
Minimum AbsoluteFlat Difference = -2.853e-04
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 10%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 56
Subwindow origin: px0=1 py0=769
silt_id='56' quad=4 row=130 col=12 slitlet_id='130_12'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = -1.200e-06 median = -3.250e-07 stdev = 4.809e-05
Maximum AbsoluteFlat Difference = 1.652e-04
Minimum AbsoluteFlat Difference = -1.662e-04
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 5%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
Working with slit: 57
Subwindow origin: px0=1 py0=355
silt_id='57' quad=4 row=150 col=94 slitlet_id='150_94'
Now looping through the pixels, this will take a while ...
Calculating statistics...
Absolute Flat Difference : mean = 2.433e-06 median = 1.212e-07 stdev = 4.345e-05
Maximum AbsoluteFlat Difference = 1.267e-04
Minimum AbsoluteFlat Difference = -1.617e-04
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 3%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
Making histogram plot for this slitlet...
*** Result of the test: PASSED
*** Final result for flat_field test will be reported as PASSED ***
('* Script flattest_mos.py took ', '8.057708938916525 minutes to finish.')
Did flat_field validation test passed? All slitlets PASSED flat_field test.
Closing file: popenfile(path='/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_dflat_nrs2_f_01.03.fits', fd=49, position=680480640, mode='r', flags=557056)
Closing file: popenfile(path='/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_MOS_sflat_G140M_OPAQUE_FLAT1_nrs2_f_01.01.fits', fd=58, position=1006715520, mode='r', flags=557056)
Closing file: popenfile(path='/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_MOS_fflat_F100LP_01.01.fits', fd=59, position=299989440, mode='r', flags=557056)
Closing file: popenfile(path='/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/V8460001000101_msa.fits', fd=60, position=512640, mode='r', flags=557056)
Closing file: popenfile(path='/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/mos_g140m_line1_NRS2_interpolatedflat.fits', fd=61, position=24592320, mode='r', flags=557056)
Testing files for detector: nrs1
Working with uncal_file: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/ifu_prism_nrs1_uncal.fits
2021-04-23 16:07:01,919 - stpipe - INFO - PARS-DETECTOR1PIPELINE parameters found: /grp/crds/cache/references/jwst/jwst_nirspec_pars-detector1pipeline_0004.asdf
2021-04-23 16:07:01,933 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2021-04-23 16:07:01,934 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2021-04-23 16:07:01,935 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2021-04-23 16:07:01,936 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2021-04-23 16:07:01,937 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2021-04-23 16:07:01,938 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2021-04-23 16:07:01,939 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2021-04-23 16:07:01,940 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2021-04-23 16:07:01,941 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2021-04-23 16:07:01,942 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2021-04-23 16:07:01,943 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2021-04-23 16:07:01,944 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2021-04-23 16:07:01,945 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2021-04-23 16:07:01,946 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2021-04-23 16:07:01,947 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2021-04-23 16:07:01,948 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2021-04-23 16:07:01,949 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/stpipe/step.py:359: ResourceWarning: unclosed file <_io.FileIO name='/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/ifu_prism_nrs1_uncal.fits' mode='rb' closefd=True>
gc.collect()
2021-04-23 16:07:02,825 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/ifu_prism_nrs1_uncal.fits',).
2021-04-23 16:07:02,837 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 4.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 200.0, 'min_jump_to_flag_neighbors': 10.0}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2021-04-23 16:07:02,948 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'ifu_prism_nrs1_uncal.fits' reftypes = ['dark', 'gain', 'linearity', 'mask', 'persat', 'readnoise', 'refpix', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2021-04-23 16:07:02,954 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_dark_0140.fits'.
2021-04-23 16:07:02,956 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_gain_0019.fits'.
2021-04-23 16:07:02,957 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_linearity_0018.fits'.
2021-04-23 16:07:02,958 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_mask_0024.fits'.
2021-04-23 16:07:02,959 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2021-04-23 16:07:02,959 - stpipe.Detector1Pipeline - INFO - Prefetch for READNOISE reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0019.fits'.
2021-04-23 16:07:02,960 - stpipe.Detector1Pipeline - INFO - Prefetch for REFPIX reference file is 'N/A'.
2021-04-23 16:07:02,960 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is 'N/A'.
2021-04-23 16:07:02,961 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is 'N/A'.
2021-04-23 16:07:02,961 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_saturation_0020.fits'.
2021-04-23 16:07:02,962 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_superbias_0087.fits'.
2021-04-23 16:07:02,963 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2021-04-23 16:07:02,963 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2021-04-23 16:07:02,964 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2021-04-23 16:07:03,884 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs1_uncal.fits>,).
2021-04-23 16:07:03,886 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 16:07:04,117 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES and FRMDIVSR are equal; correction not needed
2021-04-23 16:07:04,118 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2021-04-23 16:07:04,119 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2021-04-23 16:07:04,738 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs1_uncal.fits>,).
2021-04-23 16:07:04,740 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 16:07:04,756 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_nirspec_mask_0024.fits
2021-04-23 16:07:05,143 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2021-04-23 16:07:05,744 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs1_uncal.fits>,).
2021-04-23 16:07:05,746 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 16:07:05,762 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_nirspec_saturation_0020.fits
2021-04-23 16:07:06,391 - stpipe.Detector1Pipeline.saturation - INFO - Detected 4320 saturated pixels
2021-04-23 16:07:06,425 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2021-04-23 16:07:06,433 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2021-04-23 16:07:07,050 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs1_uncal.fits>,).
2021-04-23 16:07:07,052 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 16:07:07,052 - stpipe.Detector1Pipeline.ipc - INFO - Step skipped.
2021-04-23 16:07:07,053 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2021-04-23 16:07:07,630 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs1_uncal.fits>,).
2021-04-23 16:07:07,632 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 16:07:07,649 - stpipe.Detector1Pipeline.superbias - INFO - Using SUPERBIAS reference file /grp/crds/cache/references/jwst/jwst_nirspec_superbias_0087.fits
2021-04-23 16:07:08,130 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias done
2021-04-23 16:07:08,741 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs1_uncal.fits>,).
2021-04-23 16:07:08,742 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2021-04-23 16:07:08,750 - stpipe.Detector1Pipeline.refpix - INFO - use_side_ref_pixels = True
2021-04-23 16:07:08,750 - stpipe.Detector1Pipeline.refpix - INFO - odd_even_columns = True
2021-04-23 16:07:08,750 - stpipe.Detector1Pipeline.refpix - INFO - side_smoothing_length = 11
2021-04-23 16:07:08,751 - stpipe.Detector1Pipeline.refpix - INFO - side_gain = 1.000000
2021-04-23 16:07:08,751 - stpipe.Detector1Pipeline.refpix - INFO - odd_even_rows = True
2021-04-23 16:07:13,528 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2021-04-23 16:07:14,237 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs1_uncal.fits>,).
2021-04-23 16:07:14,239 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 16:07:14,256 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_nirspec_linearity_0018.fits
2021-04-23 16:07:15,341 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2021-04-23 16:07:15,954 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs1_uncal.fits>,).
2021-04-23 16:07:15,955 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4', 'dark_output': None}
2021-04-23 16:07:15,972 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_nirspec_dark_0140.fits
2021-04-23 16:07:16,216 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=1, ngroups=10, nframes=1, groupgap=0
2021-04-23 16:07:16,217 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=1, ngroups=10, nframes=1, groupgap=0
2021-04-23 16:07:16,597 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2021-04-23 16:07:17,219 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs1_uncal.fits>,).
2021-04-23 16:07:17,221 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4', 'rejection_threshold': 4.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 200.0, 'min_jump_to_flag_neighbors': 10.0}
2021-04-23 16:07:17,229 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 4 sigma
2021-04-23 16:07:17,238 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0019.fits
2021-04-23 16:07:17,279 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0019.fits
2021-04-23 16:07:17,311 - stpipe.Detector1Pipeline.jump - INFO - Found 32 possible cores to use for jump detection
2021-04-23 16:07:17,598 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2021-04-23 16:07:18,034 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
2021-04-23 16:07:20,386 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 37391 pixels with at least one CR
2021-04-23 16:07:21,781 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 4.18176 sec
2021-04-23 16:07:21,783 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 4.554218
2021-04-23 16:07:21,784 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2021-04-23 16:07:22,413 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs1_uncal.fits>,).
2021-04-23 16:07:22,414 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}
2021-04-23 16:07:22,440 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0019.fits
2021-04-23 16:07:22,468 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0019.fits
2021-04-23 16:07:22,502 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2021-04-23 16:07:22,502 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/jwst/ramp_fitting/ramp_fit.py:872: RuntimeWarning: invalid value encountered in multiply
var_p4[num_int,:,:,:] *= ( segs_4[num_int,:,:,:] > 0)
2021-04-23 16:08:07,747 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 10
2021-04-23 16:08:07,748 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 1
2021-04-23 16:08:07,918 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2021-04-23 16:08:08,637 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<IFUImageModel(2048, 2048) from ifu_prism_nrs1_uncal.fits>,).
2021-04-23 16:08:08,638 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 16:08:08,686 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2021-04-23 16:08:08,687 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2021-04-23 16:08:08,688 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2021-04-23 16:08:09,273 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(1, 2048, 2048) from ifu_prism_nrs1_uncal.fits>,).
2021-04-23 16:08:09,274 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 16:08:09,316 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2021-04-23 16:08:09,317 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2021-04-23 16:08:09,318 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2021-04-23 16:08:09,319 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2021-04-23 16:08:09,319 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2021-04-23 16:08:09,329 - stpipe.AssignWcsStep - INFO - AssignWcsStep instance created.
2021-04-23 16:08:09,926 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep running with args (<IFUImageModel(2048, 2048) from ifu_prism_nrs1_uncal.fits>,).
2021-04-23 16:08:09,928 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2021-04-23 16:08:10,075 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.03312480077147484 deg
2021-04-23 16:08:10,076 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3411945700645447 deg
2021-04-23 16:08:10,077 - stpipe.AssignWcsStep - INFO - theta_y correction: -0.005294283663966503 deg
2021-04-23 16:08:10,077 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2021-04-23 16:08:13,412 - stpipe.AssignWcsStep - INFO - Created a NIRSPEC nrs_ifu pipeline with references {'distortion': None, 'filteroffset': None, 'specwcs': None, 'regions': None, 'wavelengthrange': '/grp/crds/cache/references/jwst/jwst_nirspec_wavelengthrange_0004.asdf', 'camera': '/grp/crds/cache/references/jwst/jwst_nirspec_camera_0004.asdf', 'collimator': '/grp/crds/cache/references/jwst/jwst_nirspec_collimator_0004.asdf', 'disperser': '/grp/crds/cache/references/jwst/jwst_nirspec_disperser_0034.asdf', 'fore': '/grp/crds/cache/references/jwst/jwst_nirspec_fore_0028.asdf', 'fpa': '/grp/crds/cache/references/jwst/jwst_nirspec_fpa_0005.asdf', 'msa': '/grp/crds/cache/references/jwst/jwst_nirspec_msa_0005.asdf', 'ote': '/grp/crds/cache/references/jwst/jwst_nirspec_ote_0005.asdf', 'ifupost': '/grp/crds/cache/references/jwst/jwst_nirspec_ifupost_0004.asdf', 'ifufore': '/grp/crds/cache/references/jwst/jwst_nirspec_ifufore_0003.asdf', 'ifuslicer': '/grp/crds/cache/references/jwst/jwst_nirspec_ifuslicer_0003.asdf'}
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/gwcs/geometry.py:203: RuntimeWarning: invalid value encountered in remainder
lon = np.mod(lon, 360.0 * u.deg if nquant else 360.0)
2021-04-23 16:09:16,778 - stpipe.AssignWcsStep - INFO - Update S_REGION to POLYGON ICRS 156.176998032 -45.687618307 156.178780407 -45.687618307 156.178780407 -45.686330486 156.176998032 -45.686330486
2021-04-23 16:09:16,778 - stpipe.AssignWcsStep - INFO - COMPLETED assign_wcs
2021-04-23 16:09:16,781 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep done
2021-04-23 16:09:16,790 - stpipe.MSAFlagOpenStep - INFO - MSAFlagOpenStep instance created.
2021-04-23 16:09:18,063 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep running with args (<IFUImageModel(2048, 2048) from ifu_prism_nrs1_uncal.fits>,).
2021-04-23 16:09:18,070 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-04-23 16:09:18,090 - stpipe.MSAFlagOpenStep - INFO - Using reference file /grp/crds/cache/references/jwst/jwst_nirspec_msaoper_0001.json
2021-04-23 16:09:18,091 - stpipe.JwstStep - INFO - JwstStep instance created.
2021-04-23 16:09:18,200 - stpipe.MSAFlagOpenStep - INFO - gwa_ytilt is 0.03312480077147484 deg
2021-04-23 16:09:18,201 - stpipe.MSAFlagOpenStep - INFO - gwa_xtilt is 0.3411945700645447 deg
2021-04-23 16:09:18,201 - stpipe.MSAFlagOpenStep - INFO - theta_y correction: -0.005294283663966503 deg
2021-04-23 16:09:18,202 - stpipe.MSAFlagOpenStep - INFO - theta_x correction: 0.0 deg
2021-04-23 16:09:18,210 - stpipe.MSAFlagOpenStep - INFO - SPORDER= 0, wrange=[6e-07, 5.3e-06]
2021-04-23 16:09:18,300 - stpipe.MSAFlagOpenStep - INFO - There are 5 open slits in quadrant 1
2021-04-23 16:09:18,340 - stpipe.MSAFlagOpenStep - INFO - There are 3 open slits in quadrant 2
2021-04-23 16:09:18,365 - stpipe.MSAFlagOpenStep - INFO - There are 9 open slits in quadrant 3
2021-04-23 16:09:18,438 - stpipe.MSAFlagOpenStep - INFO - There are 3 open slits in quadrant 4
2021-04-23 16:09:18,463 - stpipe.MSAFlagOpenStep - INFO - There are 0 open slits in quadrant 5
2021-04-23 16:09:31,531 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep done
2021-04-23 16:09:31,540 - stpipe.SourceTypeStep - INFO - SourceTypeStep instance created.
2021-04-23 16:09:32,424 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep running with args (<IFUImageModel(2048, 2048) from ifu_prism_nrs1_uncal.fits>,).
2021-04-23 16:09:32,430 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-04-23 16:09:32,437 - stpipe.SourceTypeStep - INFO - Input EXP_TYPE is NRS_IFU
2021-04-23 16:09:32,437 - stpipe.SourceTypeStep - INFO - Input SRCTYAPT = UNKNOWN
2021-04-23 16:09:32,438 - stpipe.SourceTypeStep - INFO - Input source type is unknown; setting default SRCTYPE = EXTENDED
2021-04-23 16:09:32,438 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep done
2021-04-23 16:09:32,447 - stpipe.WavecorrStep - INFO - WavecorrStep instance created.
2021-04-23 16:09:32,898 - stpipe.WavecorrStep - INFO - Step WavecorrStep running with args (<IFUImageModel(2048, 2048) from ifu_prism_nrs1_uncal.fits>,).
2021-04-23 16:09:32,899 - stpipe.WavecorrStep - INFO - Step WavecorrStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-04-23 16:09:32,906 - stpipe.WavecorrStep - INFO - Skipping wavecorr correction for EXP_TYPE NRS_IFU
2021-04-23 16:09:32,906 - stpipe.WavecorrStep - INFO - Step WavecorrStep done
2021-04-23 16:09:32,915 - stpipe.FlatFieldStep - INFO - FlatFieldStep instance created.
2021-04-23 16:09:33,366 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep running with args (<IFUImageModel(2048, 2048) from ifu_prism_nrs1_uncal.fits>,).
2021-04-23 16:09:33,367 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': True, 'user_supplied_flat': None, 'inverse': False}
2021-04-23 16:12:17,817 - stpipe.FlatFieldStep - INFO - Saved model in ifu_prism_nrs1_interpolatedflat.fits
2021-04-23 16:12:17,818 - stpipe.FlatFieldStep - INFO - Interpolated flat written to "ifu_prism_nrs1_interpolatedflat.fits".
2021-04-23 16:12:17,820 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep done
Running flat field test for IFU... flat_field_file --> Grating:PRISM Filter:CLEAR LAMP:NO_LAMP Getting and reading the D-, S-, and F-flats for this specific IFU configuration... Using D-flat: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_dflat_nrs1_f_01.03.fits Using S-flat: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_IFU_sflat_PRISM_OPAQUE_FLAT5_nrs1_f_01.01.fits Using F-flat: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_IFU_fflat_CLEAR_01.01.fits Now looping through the slices, this may take some time... Working with slice: 00 Subwindow origin: px0=562 py0=780 Looping through the wavelength, this may take a little time ...
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/gwcs/geometry.py:203: RuntimeWarning: invalid value encountered in remainder lon = np.mod(lon, 360.0 * u.deg if nquant else 360.0) /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/gwcs/utils.py:72: DeprecationWarning: `np.int` is a deprecated alias for the builtin `int`. To silence this warning, use `int` by itself. Doing this will not modify any behavior and is safe. When replacing `np.int`, you may wish to use e.g. `np.int64` or `np.int32` to specify the precision. If you wish to review your current use, check the release note link for additional information. Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations indx = np.asarray(np.floor(np.asarray(value) + 0.5), dtype=np.int)
Flat value differences for slice number: 00
Absolute Flat Difference : mean = 4.399e-04 median = -1.236e-06 stdev = 1.180e-02
Maximum AbsoluteFlat Difference = 4.103e-01
Minimum AbsoluteFlat Difference = -8.209e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 60%
-> 3xtheshold = 22%
-> 5xtheshold = 10%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 01
Subwindow origin: px0=506 py0=1197
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 01
Absolute Flat Difference : mean = 5.497e-04 median = 1.559e-06 stdev = 1.437e-02
Maximum AbsoluteFlat Difference = 5.024e-01
Minimum AbsoluteFlat Difference = -8.178e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 61%
-> 3xtheshold = 24%
-> 5xtheshold = 11%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
*** WARNING: More than 10% of pixels have a median value greater than 5xthreshold!
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 02
Subwindow origin: px0=568 py0=730
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 02
Absolute Flat Difference : mean = 5.392e-04 median = 5.428e-06 stdev = 1.296e-02
Maximum AbsoluteFlat Difference = 4.222e-01
Minimum AbsoluteFlat Difference = -8.054e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 61%
-> 3xtheshold = 23%
-> 5xtheshold = 11%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
*** WARNING: More than 10% of pixels have a median value greater than 5xthreshold!
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 03
Subwindow origin: px0=499 py0=1246
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 03
Absolute Flat Difference : mean = 5.337e-04 median = 7.598e-07 stdev = 1.405e-02
Maximum AbsoluteFlat Difference = 4.636e-01
Minimum AbsoluteFlat Difference = -7.354e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 61%
-> 3xtheshold = 24%
-> 5xtheshold = 11%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
*** WARNING: More than 10% of pixels have a median value greater than 5xthreshold!
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 04
Subwindow origin: px0=574 py0=681
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 04
Absolute Flat Difference : mean = 4.418e-04 median = 9.397e-07 stdev = 1.130e-02
Maximum AbsoluteFlat Difference = 3.832e-01
Minimum AbsoluteFlat Difference = -1.048e-02
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 61%
-> 3xtheshold = 23%
-> 5xtheshold = 11%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
*** WARNING: More than 10% of pixels have a median value greater than 5xthreshold!
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 05
Subwindow origin: px0=492 py0=1295
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 05
Absolute Flat Difference : mean = 5.258e-04 median = 2.545e-06 stdev = 1.387e-02
Maximum AbsoluteFlat Difference = 4.976e-01
Minimum AbsoluteFlat Difference = -9.628e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 62%
-> 3xtheshold = 23%
-> 5xtheshold = 11%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
*** WARNING: More than 10% of pixels have a median value greater than 5xthreshold!
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 06
Subwindow origin: px0=580 py0=632
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 06
Absolute Flat Difference : mean = 4.203e-04 median = 1.316e-06 stdev = 1.111e-02
Maximum AbsoluteFlat Difference = 4.687e-01
Minimum AbsoluteFlat Difference = -9.827e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 60%
-> 3xtheshold = 22%
-> 5xtheshold = 11%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
*** WARNING: More than 10% of pixels have a median value greater than 5xthreshold!
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 07
Subwindow origin: px0=485 py0=1345
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 07
Absolute Flat Difference : mean = 5.510e-04 median = 9.556e-07 stdev = 1.442e-02
Maximum AbsoluteFlat Difference = 5.002e-01
Minimum AbsoluteFlat Difference = -9.173e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 62%
-> 3xtheshold = 24%
-> 5xtheshold = 11%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
*** WARNING: More than 10% of pixels have a median value greater than 5xthreshold!
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 08
Subwindow origin: px0=586 py0=582
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 08
Absolute Flat Difference : mean = 5.069e-04 median = 1.509e-06 stdev = 1.209e-02
Maximum AbsoluteFlat Difference = 3.753e-01
Minimum AbsoluteFlat Difference = -8.025e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 61%
-> 3xtheshold = 23%
-> 5xtheshold = 11%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
*** WARNING: More than 10% of pixels have a median value greater than 5xthreshold!
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 09
Subwindow origin: px0=478 py0=1394
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 09
Absolute Flat Difference : mean = 5.150e-04 median = 3.650e-06 stdev = 1.402e-02
Maximum AbsoluteFlat Difference = 4.908e-01
Minimum AbsoluteFlat Difference = -1.129e-02
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 61%
-> 3xtheshold = 23%
-> 5xtheshold = 11%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
*** WARNING: More than 10% of pixels have a median value greater than 5xthreshold!
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 10
Subwindow origin: px0=592 py0=533
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 10
Absolute Flat Difference : mean = 4.279e-04 median = 1.833e-06 stdev = 1.093e-02
Maximum AbsoluteFlat Difference = 3.913e-01
Minimum AbsoluteFlat Difference = -1.228e-02
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 60%
-> 3xtheshold = 22%
-> 5xtheshold = 11%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
*** WARNING: More than 10% of pixels have a median value greater than 5xthreshold!
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 11
Subwindow origin: px0=470 py0=1443
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 11
Absolute Flat Difference : mean = 5.046e-04 median = 3.494e-06 stdev = 1.387e-02
Maximum AbsoluteFlat Difference = 4.866e-01
Minimum AbsoluteFlat Difference = -1.194e-02
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 61%
-> 3xtheshold = 24%
-> 5xtheshold = 12%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
*** WARNING: More than 10% of pixels have a median value greater than 5xthreshold!
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 12
Subwindow origin: px0=598 py0=484
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 12
Absolute Flat Difference : mean = 4.585e-04 median = 4.425e-06 stdev = 1.110e-02
Maximum AbsoluteFlat Difference = 3.533e-01
Minimum AbsoluteFlat Difference = -1.426e-02
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 60%
-> 3xtheshold = 23%
-> 5xtheshold = 11%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
*** WARNING: More than 10% of pixels have a median value greater than 5xthreshold!
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 13
Subwindow origin: px0=463 py0=1492
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 13
Absolute Flat Difference : mean = 5.434e-04 median = 1.948e-06 stdev = 1.427e-02
Maximum AbsoluteFlat Difference = 5.157e-01
Minimum AbsoluteFlat Difference = -1.325e-02
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 62%
-> 3xtheshold = 24%
-> 5xtheshold = 12%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
*** WARNING: More than 10% of pixels have a median value greater than 5xthreshold!
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 14
Subwindow origin: px0=604 py0=434
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 14
Absolute Flat Difference : mean = 3.893e-04 median = -1.099e-07 stdev = 9.772e-03
Maximum AbsoluteFlat Difference = 3.265e-01
Minimum AbsoluteFlat Difference = -8.879e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 59%
-> 3xtheshold = 22%
-> 5xtheshold = 11%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
*** WARNING: More than 10% of pixels have a median value greater than 5xthreshold!
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 15
Subwindow origin: px0=456 py0=1541
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 15
Absolute Flat Difference : mean = 4.996e-04 median = 3.020e-06 stdev = 1.347e-02
Maximum AbsoluteFlat Difference = 4.821e-01
Minimum AbsoluteFlat Difference = -1.812e-02
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 61%
-> 3xtheshold = 24%
-> 5xtheshold = 11%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
*** WARNING: More than 10% of pixels have a median value greater than 5xthreshold!
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 16
Subwindow origin: px0=609 py0=385
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 16
Absolute Flat Difference : mean = 4.162e-04 median = 2.894e-06 stdev = 9.933e-03
Maximum AbsoluteFlat Difference = 3.199e-01
Minimum AbsoluteFlat Difference = -1.015e-02
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 60%
-> 3xtheshold = 22%
-> 5xtheshold = 11%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
*** WARNING: More than 10% of pixels have a median value greater than 5xthreshold!
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 17
Subwindow origin: px0=448 py0=1590
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 17
Absolute Flat Difference : mean = 5.331e-04 median = 2.242e-06 stdev = 1.385e-02
Maximum AbsoluteFlat Difference = 4.789e-01
Minimum AbsoluteFlat Difference = -9.371e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 61%
-> 3xtheshold = 24%
-> 5xtheshold = 12%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
*** WARNING: More than 10% of pixels have a median value greater than 5xthreshold!
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 18
Subwindow origin: px0=615 py0=336
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 18
Absolute Flat Difference : mean = 3.429e-04 median = 3.918e-07 stdev = 8.902e-03
Maximum AbsoluteFlat Difference = 3.218e-01
Minimum AbsoluteFlat Difference = -9.723e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 59%
-> 3xtheshold = 21%
-> 5xtheshold = 11%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
*** WARNING: More than 10% of pixels have a median value greater than 5xthreshold!
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 19
Subwindow origin: px0=441 py0=1639
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 19
Absolute Flat Difference : mean = 5.134e-04 median = -1.441e-06 stdev = 1.405e-02
Maximum AbsoluteFlat Difference = 4.968e-01
Minimum AbsoluteFlat Difference = -7.162e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 62%
-> 3xtheshold = 24%
-> 5xtheshold = 11%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
*** WARNING: More than 10% of pixels have a median value greater than 5xthreshold!
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 20
Subwindow origin: px0=620 py0=286
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 20
Absolute Flat Difference : mean = 3.888e-04 median = 9.787e-07 stdev = 9.694e-03
Maximum AbsoluteFlat Difference = 3.320e-01
Minimum AbsoluteFlat Difference = -1.161e-02
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 58%
-> 3xtheshold = 21%
-> 5xtheshold = 10%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 21
Subwindow origin: px0=433 py0=1688
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 21
Absolute Flat Difference : mean = 5.282e-04 median = 2.358e-06 stdev = 1.421e-02
Maximum AbsoluteFlat Difference = 4.832e-01
Minimum AbsoluteFlat Difference = -1.063e-02
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 62%
-> 3xtheshold = 24%
-> 5xtheshold = 12%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
*** WARNING: More than 10% of pixels have a median value greater than 5xthreshold!
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 22
Subwindow origin: px0=626 py0=237
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 22
Absolute Flat Difference : mean = 4.491e-04 median = 8.085e-07 stdev = 1.146e-02
Maximum AbsoluteFlat Difference = 3.635e-01
Minimum AbsoluteFlat Difference = -4.442e-02
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 58%
-> 3xtheshold = 21%
-> 5xtheshold = 10%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 23
Subwindow origin: px0=425 py0=1737
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 23
Absolute Flat Difference : mean = 5.628e-04 median = 2.145e-06 stdev = 1.471e-02
Maximum AbsoluteFlat Difference = 5.054e-01
Minimum AbsoluteFlat Difference = -1.136e-02
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 63%
-> 3xtheshold = 24%
-> 5xtheshold = 11%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
*** WARNING: More than 10% of pixels have a median value greater than 5xthreshold!
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 24
Subwindow origin: px0=631 py0=187
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 24
Absolute Flat Difference : mean = 4.288e-04 median = 2.904e-06 stdev = 1.111e-02
Maximum AbsoluteFlat Difference = 4.153e-01
Minimum AbsoluteFlat Difference = -1.016e-02
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 58%
-> 3xtheshold = 20%
-> 5xtheshold = 10%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 25
Subwindow origin: px0=417 py0=1785
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 25
Absolute Flat Difference : mean = 4.891e-04 median = 2.706e-06 stdev = 1.286e-02
Maximum AbsoluteFlat Difference = 4.402e-01
Minimum AbsoluteFlat Difference = -9.453e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 62%
-> 3xtheshold = 23%
-> 5xtheshold = 11%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
*** WARNING: More than 10% of pixels have a median value greater than 5xthreshold!
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 26
Subwindow origin: px0=636 py0=138
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 26
Absolute Flat Difference : mean = 4.232e-04 median = 9.655e-07 stdev = 1.083e-02
Maximum AbsoluteFlat Difference = 3.777e-01
Minimum AbsoluteFlat Difference = -1.013e-02
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 59%
-> 3xtheshold = 20%
-> 5xtheshold = 10%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 27
Subwindow origin: px0=409 py0=1834
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 27
Absolute Flat Difference : mean = 4.272e-04 median = -3.782e-09 stdev = 1.192e-02
Maximum AbsoluteFlat Difference = 4.255e-01
Minimum AbsoluteFlat Difference = -9.992e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 62%
-> 3xtheshold = 24%
-> 5xtheshold = 12%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
*** WARNING: More than 10% of pixels have a median value greater than 5xthreshold!
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 28
Subwindow origin: px0=641 py0=88
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 28
Absolute Flat Difference : mean = 4.298e-04 median = -6.644e-08 stdev = 1.061e-02
Maximum AbsoluteFlat Difference = 3.701e-01
Minimum AbsoluteFlat Difference = -9.064e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 57%
-> 3xtheshold = 19%
-> 5xtheshold = 10%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 29
Subwindow origin: px0=402 py0=1883
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 29
Absolute Flat Difference : mean = 4.693e-04 median = 2.718e-06 stdev = 1.216e-02
Maximum AbsoluteFlat Difference = 4.182e-01
Minimum AbsoluteFlat Difference = -1.895e-02
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 63%
-> 3xtheshold = 24%
-> 5xtheshold = 12%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
*** WARNING: More than 10% of pixels have a median value greater than 5xthreshold!
Making the plot for this slice...
*** Result of the test: PASSED
*** Final result for flat_field test will be reported as PASSED ***
('* Script flattest_ifu.py script took ', '48.25882730086644 minutes to finish.')
Did flat_field validation test passed? All slices PASSED flat_field test.
Closing file: popenfile(path='/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/ifu_prism_nrs1_interpolatedflat.fits', fd=46, position=16804800, mode='r', flags=557056)
Closing file: popenfile(path='/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_dflat_nrs1_f_01.03.fits', fd=47, position=680480640, mode='r', flags=557056)
Closing file: popenfile(path='/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_IFU_sflat_PRISM_OPAQUE_FLAT5_nrs1_f_01.01.fits', fd=48, position=50463360, mode='r', flags=557056)
Closing file: popenfile(path='/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_IFU_fflat_CLEAR_01.01.fits', fd=49, position=86400, mode='r', flags=557056)
Testing files for detector: nrs2
Working with uncal_file: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/ifu_prism_nrs2_uncal.fits
2021-04-23 17:00:35,519 - stpipe - INFO - PARS-DETECTOR1PIPELINE parameters found: /grp/crds/cache/references/jwst/jwst_nirspec_pars-detector1pipeline_0004.asdf
2021-04-23 17:00:35,533 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2021-04-23 17:00:35,534 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2021-04-23 17:00:35,535 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2021-04-23 17:00:35,536 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2021-04-23 17:00:35,537 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2021-04-23 17:00:35,538 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2021-04-23 17:00:35,539 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2021-04-23 17:00:35,540 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2021-04-23 17:00:35,541 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2021-04-23 17:00:35,542 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2021-04-23 17:00:35,543 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2021-04-23 17:00:35,544 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2021-04-23 17:00:35,545 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2021-04-23 17:00:35,546 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2021-04-23 17:00:35,547 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2021-04-23 17:00:35,548 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2021-04-23 17:00:35,549 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/stpipe/step.py:359: ResourceWarning: unclosed file <_io.FileIO name='/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/ifu_prism_nrs2_uncal.fits' mode='rb' closefd=True>
gc.collect()
2021-04-23 17:00:36,319 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/ifu_prism_nrs2_uncal.fits',).
2021-04-23 17:00:36,336 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 4.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 200.0, 'min_jump_to_flag_neighbors': 10.0}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2021-04-23 17:00:36,516 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'ifu_prism_nrs2_uncal.fits' reftypes = ['dark', 'gain', 'linearity', 'mask', 'persat', 'readnoise', 'refpix', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2021-04-23 17:00:36,523 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_dark_0143.fits'.
2021-04-23 17:00:36,525 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_gain_0018.fits'.
2021-04-23 17:00:36,526 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_linearity_0021.fits'.
2021-04-23 17:00:36,527 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_mask_0025.fits'.
2021-04-23 17:00:36,528 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2021-04-23 17:00:36,528 - stpipe.Detector1Pipeline - INFO - Prefetch for READNOISE reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0016.fits'.
2021-04-23 17:00:36,530 - stpipe.Detector1Pipeline - INFO - Prefetch for REFPIX reference file is 'N/A'.
2021-04-23 17:00:36,530 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is 'N/A'.
2021-04-23 17:00:36,530 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is 'N/A'.
2021-04-23 17:00:36,531 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_saturation_0021.fits'.
2021-04-23 17:00:36,532 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_superbias_0104.fits'.
2021-04-23 17:00:36,533 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2021-04-23 17:00:36,533 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2021-04-23 17:00:36,533 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2021-04-23 17:00:37,042 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs2_uncal.fits>,).
2021-04-23 17:00:37,044 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 17:00:37,208 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES and FRMDIVSR are equal; correction not needed
2021-04-23 17:00:37,209 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2021-04-23 17:00:37,210 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2021-04-23 17:00:37,489 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs2_uncal.fits>,).
2021-04-23 17:00:37,491 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 17:00:37,507 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_nirspec_mask_0025.fits
2021-04-23 17:00:37,897 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2021-04-23 17:00:38,177 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs2_uncal.fits>,).
2021-04-23 17:00:38,178 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 17:00:38,194 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_nirspec_saturation_0021.fits
2021-04-23 17:00:38,719 - stpipe.Detector1Pipeline.saturation - INFO - Detected 2388 saturated pixels
2021-04-23 17:00:38,765 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2021-04-23 17:00:38,773 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2021-04-23 17:00:39,081 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs2_uncal.fits>,).
2021-04-23 17:00:39,082 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 17:00:39,083 - stpipe.Detector1Pipeline.ipc - INFO - Step skipped.
2021-04-23 17:00:39,083 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2021-04-23 17:00:39,360 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs2_uncal.fits>,).
2021-04-23 17:00:39,361 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 17:00:39,378 - stpipe.Detector1Pipeline.superbias - INFO - Using SUPERBIAS reference file /grp/crds/cache/references/jwst/jwst_nirspec_superbias_0104.fits
2021-04-23 17:00:39,782 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias done
2021-04-23 17:00:40,062 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs2_uncal.fits>,).
2021-04-23 17:00:40,064 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2021-04-23 17:00:40,071 - stpipe.Detector1Pipeline.refpix - INFO - use_side_ref_pixels = True
2021-04-23 17:00:40,071 - stpipe.Detector1Pipeline.refpix - INFO - odd_even_columns = True
2021-04-23 17:00:40,071 - stpipe.Detector1Pipeline.refpix - INFO - side_smoothing_length = 11
2021-04-23 17:00:40,072 - stpipe.Detector1Pipeline.refpix - INFO - side_gain = 1.000000
2021-04-23 17:00:40,072 - stpipe.Detector1Pipeline.refpix - INFO - odd_even_rows = True
2021-04-23 17:00:47,287 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2021-04-23 17:00:47,790 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs2_uncal.fits>,).
2021-04-23 17:00:47,793 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 17:00:47,811 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_nirspec_linearity_0021.fits
2021-04-23 17:00:48,845 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2021-04-23 17:00:49,147 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs2_uncal.fits>,).
2021-04-23 17:00:49,149 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4', 'dark_output': None}
2021-04-23 17:00:49,166 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_nirspec_dark_0143.fits
2021-04-23 17:00:49,358 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=1, ngroups=10, nframes=1, groupgap=0
2021-04-23 17:00:49,359 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=1, ngroups=10, nframes=1, groupgap=0
2021-04-23 17:00:49,692 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2021-04-23 17:00:50,031 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs2_uncal.fits>,).
2021-04-23 17:00:50,034 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4', 'rejection_threshold': 4.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 200.0, 'min_jump_to_flag_neighbors': 10.0}
2021-04-23 17:00:50,042 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 4 sigma
2021-04-23 17:00:50,053 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0018.fits
2021-04-23 17:00:50,103 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0016.fits
2021-04-23 17:00:50,139 - stpipe.Detector1Pipeline.jump - INFO - Found 32 possible cores to use for jump detection
2021-04-23 17:00:50,360 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2021-04-23 17:00:50,977 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
2021-04-23 17:00:53,653 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 16206 pixels with at least one CR
2021-04-23 17:00:54,485 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 4.12419 sec
2021-04-23 17:00:54,486 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 4.444169
2021-04-23 17:00:54,488 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2021-04-23 17:00:54,817 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs2_uncal.fits>,).
2021-04-23 17:00:54,819 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}
2021-04-23 17:00:54,845 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0016.fits
2021-04-23 17:00:54,874 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0018.fits
2021-04-23 17:00:54,910 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2021-04-23 17:00:54,911 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/jwst/ramp_fitting/ramp_fit.py:872: RuntimeWarning: invalid value encountered in multiply
var_p4[num_int,:,:,:] *= ( segs_4[num_int,:,:,:] > 0)
2021-04-23 17:01:34,245 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 10
2021-04-23 17:01:34,246 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 1
2021-04-23 17:01:34,412 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2021-04-23 17:01:34,738 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<IFUImageModel(2048, 2048) from ifu_prism_nrs2_uncal.fits>,).
2021-04-23 17:01:34,740 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 17:01:34,793 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2021-04-23 17:01:34,794 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2021-04-23 17:01:34,795 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2021-04-23 17:01:35,073 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(1, 2048, 2048) from ifu_prism_nrs2_uncal.fits>,).
2021-04-23 17:01:35,075 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 17:01:35,125 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2021-04-23 17:01:35,126 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2021-04-23 17:01:35,127 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2021-04-23 17:01:35,127 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2021-04-23 17:01:35,128 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2021-04-23 17:01:35,137 - stpipe.AssignWcsStep - INFO - AssignWcsStep instance created.
2021-04-23 17:01:35,424 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep running with args (<IFUImageModel(2048, 2048) from ifu_prism_nrs2_uncal.fits>,).
2021-04-23 17:01:35,425 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2021-04-23 17:01:35,561 - stpipe.AssignWcsStep - CRITICAL - No IFU slices fall on detector NRS2
No open slits fall on detector nrs2 Skipping test for this file. Did flat_field validation test passed? skipped Testing files for detector: nrs1 Working with uncal_file: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/ifu_g395h_f290lp_nrs1_uncal.fits
2021-04-23 17:01:40,005 - stpipe - INFO - PARS-DETECTOR1PIPELINE parameters found: /grp/crds/cache/references/jwst/jwst_nirspec_pars-detector1pipeline_0004.asdf
2021-04-23 17:01:40,023 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2021-04-23 17:01:40,024 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2021-04-23 17:01:40,025 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2021-04-23 17:01:40,026 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2021-04-23 17:01:40,027 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2021-04-23 17:01:40,028 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2021-04-23 17:01:40,029 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2021-04-23 17:01:40,030 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2021-04-23 17:01:40,031 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2021-04-23 17:01:40,032 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2021-04-23 17:01:40,033 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2021-04-23 17:01:40,034 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2021-04-23 17:01:40,035 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2021-04-23 17:01:40,036 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2021-04-23 17:01:40,037 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2021-04-23 17:01:40,038 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2021-04-23 17:01:40,040 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/stpipe/step.py:359: ResourceWarning: unclosed file <_io.FileIO name='/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/ifu_g395h_f290lp_nrs1_uncal.fits' mode='rb' closefd=True>
gc.collect()
2021-04-23 17:01:40,406 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/ifu_g395h_f290lp_nrs1_uncal.fits',).
2021-04-23 17:01:40,415 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 4.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 200.0, 'min_jump_to_flag_neighbors': 10.0}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2021-04-23 17:01:40,663 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'ifu_g395h_f290lp_nrs1_uncal.fits' reftypes = ['dark', 'gain', 'linearity', 'mask', 'persat', 'readnoise', 'refpix', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2021-04-23 17:01:40,671 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_dark_0088.fits'.
2021-04-23 17:01:40,673 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_gain_0023.fits'.
2021-04-23 17:01:40,674 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_linearity_0022.fits'.
2021-04-23 17:01:40,675 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_mask_0010.fits'.
2021-04-23 17:01:40,676 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2021-04-23 17:01:40,676 - stpipe.Detector1Pipeline - INFO - Prefetch for READNOISE reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0018.fits'.
2021-04-23 17:01:40,677 - stpipe.Detector1Pipeline - INFO - Prefetch for REFPIX reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_refpix_0019.fits'.
2021-04-23 17:01:40,678 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is 'N/A'.
2021-04-23 17:01:40,678 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is 'N/A'.
2021-04-23 17:01:40,679 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_saturation_0027.fits'.
2021-04-23 17:01:40,680 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_superbias_0117.fits'.
2021-04-23 17:01:40,681 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2021-04-23 17:01:40,681 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2021-04-23 17:01:40,681 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2021-04-23 17:01:41,820 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs1_uncal.fits>,).
2021-04-23 17:01:41,821 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 17:01:42,589 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES and FRMDIVSR are equal; correction not needed
2021-04-23 17:01:42,590 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2021-04-23 17:01:42,591 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2021-04-23 17:01:42,876 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs1_uncal.fits>,).
2021-04-23 17:01:42,877 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 17:01:42,893 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_nirspec_mask_0010.fits
2021-04-23 17:01:45,098 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2021-04-23 17:01:45,495 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs1_uncal.fits>,).
2021-04-23 17:01:45,497 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 17:01:45,514 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_nirspec_saturation_0027.fits
2021-04-23 17:01:48,860 - stpipe.Detector1Pipeline.saturation - INFO - Detected 131958 saturated pixels
2021-04-23 17:01:48,955 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2021-04-23 17:01:48,977 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2021-04-23 17:01:49,369 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs1_uncal.fits>,).
2021-04-23 17:01:49,371 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 17:01:49,371 - stpipe.Detector1Pipeline.ipc - INFO - Step skipped.
2021-04-23 17:01:49,372 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2021-04-23 17:01:49,651 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs1_uncal.fits>,).
2021-04-23 17:01:49,652 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 17:01:49,670 - stpipe.Detector1Pipeline.superbias - INFO - Using SUPERBIAS reference file /grp/crds/cache/references/jwst/jwst_nirspec_superbias_0117.fits
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/stdatamodels/validate.py:34: ValidationWarning: While validating meta.exposure.readpatt the following error occurred:
'ALLIRS2' is not one of ['ACQ1', 'ACQ2', 'BRIGHT1', 'BRIGHT2', 'DEEP2', 'DEEP8', 'FAST', 'FASTGRPAVG', 'FASTGRPAVG8', 'FASTGRPAVG16', 'FASTGRPAVG32', 'FASTGRPAVG64', 'FASTR1', 'FASTR100', 'FGS', 'FGS60', 'FGS8370', 'FGS840', 'FGSRAPID', 'FINEGUIDE', 'ID', 'MEDIUM2', 'MEDIUM8', 'NIS', 'NISRAPID', 'NRS', 'NRSIRS2', 'NRSN16R4', 'NRSN32R8', 'NRSN8R2', 'NRSRAPID', 'NRSIRS2RAPID', 'NRSRAPIDD1', 'NRSRAPIDD2', 'NRSRAPIDD6', 'NRSSLOW', 'RAPID', 'SHALLOW2', 'SHALLOW4', 'SLOW', 'SLOWR1', 'TRACK', 'ANY', 'N/A']
Failed validating 'enum' in schema:
OrderedDict([('title', 'Readout pattern'),
('type', 'string'),
('enum',
['ACQ1',
'ACQ2',
'BRIGHT1',
'BRIGHT2',
'DEEP2',
'DEEP8',
'FAST',
'FASTGRPAVG',
'FASTGRPAVG8',
'FASTGRPAVG16',
'FASTGRPAVG32',
'FASTGRPAVG64',
'FASTR1',
'FASTR100',
'FGS',
'FGS60',
'FGS8370',
'FGS840',
'FGSRAPID',
'FINEGUIDE',
'ID',
'MEDIUM2',
'MEDIUM8',
'NIS',
'NISRAPID',
'NRS',
'NRSIRS2',
'NRSN16R4',
'NRSN32R8',
'NRSN8R2',
'NRSRAPID',
'NRSIRS2RAPID',
'NRSRAPIDD1',
'NRSRAPIDD2',
'NRSRAPIDD6',
'NRSSLOW',
'RAPID',
'SHALLOW2',
'SHALLOW4',
'SLOW',
'SLOWR1',
'TRACK',
'ANY',
'N/A']),
('fits_ke ...
warnings.warn(errmsg, ValidationWarning)
2021-04-23 17:01:53,669 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias done
2021-04-23 17:01:54,184 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs1_uncal.fits>,).
2021-04-23 17:01:54,186 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2021-04-23 17:01:54,203 - stpipe.Detector1Pipeline.refpix - INFO - Using refpix reference file: /grp/crds/cache/references/jwst/jwst_nirspec_refpix_0019.fits
2021-04-23 17:03:05,994 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2021-04-23 17:03:06,441 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs1_uncal.fits>,).
2021-04-23 17:03:06,443 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 17:03:06,464 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_nirspec_linearity_0022.fits
2021-04-23 17:03:08,247 - stpipe.Detector1Pipeline.linearity - WARNING - Keyword BAD_LIN_CORR does not correspond to an existing DQ mnemonic, so will be ignored
2021-04-23 17:03:09,711 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2021-04-23 17:03:10,079 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs1_uncal.fits>,).
2021-04-23 17:03:10,081 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4', 'dark_output': None}
2021-04-23 17:03:10,099 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_nirspec_dark_0088.fits
2021-04-23 17:03:50,914 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=1, ngroups=20, nframes=1, groupgap=0
2021-04-23 17:03:50,916 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=1, ngroups=65, nframes=1, groupgap=0
2021-04-23 17:03:51,895 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2021-04-23 17:03:52,871 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs1_uncal.fits>,).
2021-04-23 17:03:52,872 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4', 'rejection_threshold': 4.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 200.0, 'min_jump_to_flag_neighbors': 10.0}
2021-04-23 17:03:52,880 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 4 sigma
2021-04-23 17:03:52,892 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0023.fits
2021-04-23 17:03:53,588 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0018.fits
2021-04-23 17:03:55,010 - stpipe.Detector1Pipeline.jump - INFO - Found 32 possible cores to use for jump detection
2021-04-23 17:03:55,623 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2021-04-23 17:03:56,421 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
2021-04-23 17:04:00,282 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 86673 pixels with at least one CR
2021-04-23 17:04:06,643 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 11.0189 sec
2021-04-23 17:04:06,645 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 13.764229
2021-04-23 17:04:06,646 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2021-04-23 17:04:07,025 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs1_uncal.fits>,).
2021-04-23 17:04:07,027 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}
2021-04-23 17:04:07,059 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0018.fits
2021-04-23 17:04:07,098 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0023.fits
2021-04-23 17:04:07,118 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2021-04-23 17:04:07,118 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/jwst/ramp_fitting/ramp_fit.py:872: RuntimeWarning: invalid value encountered in multiply
var_p4[num_int,:,:,:] *= ( segs_4[num_int,:,:,:] > 0)
2021-04-23 17:06:50,850 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 20
2021-04-23 17:06:50,851 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 1
2021-04-23 17:06:50,988 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2021-04-23 17:06:51,374 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<IFUImageModel(2048, 2048) from ifu_g395h_f290lp_nrs1_uncal.fits>,).
2021-04-23 17:06:51,375 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 17:06:51,426 - stpipe.Detector1Pipeline.gain_scale - INFO - Rescaling by 1.0
2021-04-23 17:06:51,435 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2021-04-23 17:06:51,712 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(1, 2048, 2048) from ifu_g395h_f290lp_nrs1_uncal.fits>,).
2021-04-23 17:06:51,714 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 17:06:51,774 - stpipe.Detector1Pipeline.gain_scale - INFO - Rescaling by 1.0
2021-04-23 17:06:51,783 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2021-04-23 17:06:51,784 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2021-04-23 17:06:51,784 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2021-04-23 17:06:51,794 - stpipe.AssignWcsStep - INFO - AssignWcsStep instance created.
2021-04-23 17:06:52,167 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep running with args (<IFUImageModel(2048, 2048) from ifu_g395h_f290lp_nrs1_uncal.fits>,).
2021-04-23 17:06:52,169 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2021-04-23 17:06:52,321 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.1448970586061478 deg
2021-04-23 17:06:52,321 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3232757747173309 deg
2021-04-23 17:06:52,322 - stpipe.AssignWcsStep - INFO - theta_y correction: -3.766823889842878e-13 deg
2021-04-23 17:06:52,322 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2021-04-23 17:06:55,771 - stpipe.AssignWcsStep - INFO - Created a NIRSPEC nrs_ifu pipeline with references {'distortion': None, 'filteroffset': None, 'specwcs': None, 'regions': None, 'wavelengthrange': '/grp/crds/cache/references/jwst/jwst_nirspec_wavelengthrange_0004.asdf', 'camera': '/grp/crds/cache/references/jwst/jwst_nirspec_camera_0004.asdf', 'collimator': '/grp/crds/cache/references/jwst/jwst_nirspec_collimator_0004.asdf', 'disperser': '/grp/crds/cache/references/jwst/jwst_nirspec_disperser_0035.asdf', 'fore': '/grp/crds/cache/references/jwst/jwst_nirspec_fore_0022.asdf', 'fpa': '/grp/crds/cache/references/jwst/jwst_nirspec_fpa_0005.asdf', 'msa': '/grp/crds/cache/references/jwst/jwst_nirspec_msa_0005.asdf', 'ote': '/grp/crds/cache/references/jwst/jwst_nirspec_ote_0005.asdf', 'ifupost': '/grp/crds/cache/references/jwst/jwst_nirspec_ifupost_0004.asdf', 'ifufore': '/grp/crds/cache/references/jwst/jwst_nirspec_ifufore_0003.asdf', 'ifuslicer': '/grp/crds/cache/references/jwst/jwst_nirspec_ifuslicer_0003.asdf'}
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/gwcs/geometry.py:203: RuntimeWarning: invalid value encountered in remainder
lon = np.mod(lon, 360.0 * u.deg if nquant else 360.0)
2021-04-23 17:08:01,425 - stpipe.AssignWcsStep - INFO - Update S_REGION to POLYGON ICRS 156.176999392 -45.687618156 156.178775679 -45.687618156 156.178775679 -45.686331563 156.176999392 -45.686331563
2021-04-23 17:08:01,426 - stpipe.AssignWcsStep - INFO - COMPLETED assign_wcs
2021-04-23 17:08:01,429 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep done
2021-04-23 17:08:01,438 - stpipe.MSAFlagOpenStep - INFO - MSAFlagOpenStep instance created.
2021-04-23 17:08:02,300 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep running with args (<IFUImageModel(2048, 2048) from ifu_g395h_f290lp_nrs1_uncal.fits>,).
2021-04-23 17:08:02,306 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-04-23 17:08:02,328 - stpipe.MSAFlagOpenStep - INFO - Using reference file /grp/crds/cache/references/jwst/jwst_nirspec_msaoper_0001.json
2021-04-23 17:08:02,329 - stpipe.JwstStep - INFO - JwstStep instance created.
2021-04-23 17:08:02,443 - stpipe.MSAFlagOpenStep - INFO - gwa_ytilt is 0.1448970586061478 deg
2021-04-23 17:08:02,444 - stpipe.MSAFlagOpenStep - INFO - gwa_xtilt is 0.3232757747173309 deg
2021-04-23 17:08:02,445 - stpipe.MSAFlagOpenStep - INFO - theta_y correction: -3.766823889842878e-13 deg
2021-04-23 17:08:02,446 - stpipe.MSAFlagOpenStep - INFO - theta_x correction: 0.0 deg
2021-04-23 17:08:02,456 - stpipe.MSAFlagOpenStep - INFO - SPORDER= -1, wrange=[2.87e-06, 5.27e-06]
2021-04-23 17:08:02,550 - stpipe.MSAFlagOpenStep - INFO - There are 5 open slits in quadrant 1
2021-04-23 17:08:02,592 - stpipe.MSAFlagOpenStep - INFO - There are 3 open slits in quadrant 2
2021-04-23 17:08:02,618 - stpipe.MSAFlagOpenStep - INFO - There are 9 open slits in quadrant 3
2021-04-23 17:08:02,693 - stpipe.MSAFlagOpenStep - INFO - There are 3 open slits in quadrant 4
2021-04-23 17:08:02,719 - stpipe.MSAFlagOpenStep - INFO - There are 0 open slits in quadrant 5
2021-04-23 17:08:16,199 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep done
2021-04-23 17:08:16,209 - stpipe.SourceTypeStep - INFO - SourceTypeStep instance created.
2021-04-23 17:08:16,830 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep running with args (<IFUImageModel(2048, 2048) from ifu_g395h_f290lp_nrs1_uncal.fits>,).
2021-04-23 17:08:16,835 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-04-23 17:08:16,842 - stpipe.SourceTypeStep - INFO - Input EXP_TYPE is NRS_IFU
2021-04-23 17:08:16,842 - stpipe.SourceTypeStep - INFO - Input SRCTYAPT = UNKNOWN
2021-04-23 17:08:16,843 - stpipe.SourceTypeStep - INFO - Input source type is unknown; setting default SRCTYPE = EXTENDED
2021-04-23 17:08:16,843 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep done
2021-04-23 17:08:16,852 - stpipe.WavecorrStep - INFO - WavecorrStep instance created.
2021-04-23 17:08:17,163 - stpipe.WavecorrStep - INFO - Step WavecorrStep running with args (<IFUImageModel(2048, 2048) from ifu_g395h_f290lp_nrs1_uncal.fits>,).
2021-04-23 17:08:17,164 - stpipe.WavecorrStep - INFO - Step WavecorrStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-04-23 17:08:17,172 - stpipe.WavecorrStep - INFO - Skipping wavecorr correction for EXP_TYPE NRS_IFU
2021-04-23 17:08:17,172 - stpipe.WavecorrStep - INFO - Step WavecorrStep done
2021-04-23 17:08:17,181 - stpipe.FlatFieldStep - INFO - FlatFieldStep instance created.
2021-04-23 17:08:17,491 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep running with args (<IFUImageModel(2048, 2048) from ifu_g395h_f290lp_nrs1_uncal.fits>,).
2021-04-23 17:08:17,493 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': True, 'user_supplied_flat': None, 'inverse': False}
2021-04-23 17:15:45,503 - stpipe.FlatFieldStep - INFO - Saved model in ifu_g395h_f290lp_nrs1_interpolatedflat.fits
2021-04-23 17:15:45,504 - stpipe.FlatFieldStep - INFO - Interpolated flat written to "ifu_g395h_f290lp_nrs1_interpolatedflat.fits".
2021-04-23 17:15:45,506 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep done
Running flat field test for IFU... flat_field_file --> Grating:G395H Filter:F290LP LAMP:REF Getting and reading the D-, S-, and F-flats for this specific IFU configuration... Using D-flat: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_dflat_nrs1_f_01.03.fits Using S-flat: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_IFU_sflat_G395H_OPAQUE_FLAT3_nrs1_f_01.01.fits Using F-flat: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_IFU_fflat_F290LP_01.01.fits Now looping through the slices, this may take some time... Working with slice: 00 Subwindow origin: px0=275 py0=781
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/gwcs/geometry.py:203: RuntimeWarning: invalid value encountered in remainder lon = np.mod(lon, 360.0 * u.deg if nquant else 360.0) /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/gwcs/utils.py:72: DeprecationWarning: `np.int` is a deprecated alias for the builtin `int`. To silence this warning, use `int` by itself. Doing this will not modify any behavior and is safe. When replacing `np.int`, you may wish to use e.g. `np.int64` or `np.int32` to specify the precision. If you wish to review your current use, check the release note link for additional information. Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations indx = np.asarray(np.floor(np.asarray(value) + 0.5), dtype=np.int)
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 00
Absolute Flat Difference : mean = nan median = nan stdev = nan
Maximum AbsoluteFlat Difference = nan
Minimum AbsoluteFlat Difference = nan
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 25%
-> 3xtheshold = 1%
-> 5xtheshold = 0%
*** Result of the test: FAILED
Unable to determine mean, meadian, and std_dev for the slice00
Working with slice: 01
Subwindow origin: px0=312 py0=1197
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 01
Absolute Flat Difference : mean = nan median = nan stdev = nan
Maximum AbsoluteFlat Difference = nan
Minimum AbsoluteFlat Difference = nan
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 29%
-> 3xtheshold = 1%
-> 5xtheshold = 0%
*** Result of the test: FAILED
Unable to determine mean, meadian, and std_dev for the slice01
Working with slice: 02
Subwindow origin: px0=271 py0=731
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 02
Absolute Flat Difference : mean = nan median = nan stdev = nan
Maximum AbsoluteFlat Difference = nan
Minimum AbsoluteFlat Difference = nan
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 26%
-> 3xtheshold = 1%
-> 5xtheshold = 0%
*** Result of the test: FAILED
Unable to determine mean, meadian, and std_dev for the slice02
Working with slice: 03
Subwindow origin: px0=317 py0=1246
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 03
Absolute Flat Difference : mean = nan median = nan stdev = nan
Maximum AbsoluteFlat Difference = nan
Minimum AbsoluteFlat Difference = nan
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 28%
-> 3xtheshold = 1%
-> 5xtheshold = 0%
*** Result of the test: FAILED
Unable to determine mean, meadian, and std_dev for the slice03
Working with slice: 04
Subwindow origin: px0=266 py0=682
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 04
Absolute Flat Difference : mean = nan median = nan stdev = nan
Maximum AbsoluteFlat Difference = nan
Minimum AbsoluteFlat Difference = nan
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 26%
-> 3xtheshold = 1%
-> 5xtheshold = 0%
*** Result of the test: FAILED
Unable to determine mean, meadian, and std_dev for the slice04
Working with slice: 05
Subwindow origin: px0=321 py0=1296
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 05
Absolute Flat Difference : mean = nan median = nan stdev = nan
Maximum AbsoluteFlat Difference = nan
Minimum AbsoluteFlat Difference = nan
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 28%
-> 3xtheshold = 1%
-> 5xtheshold = 0%
*** Result of the test: FAILED
Unable to determine mean, meadian, and std_dev for the slice05
Working with slice: 06
Subwindow origin: px0=262 py0=633
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 06
Absolute Flat Difference : mean = nan median = nan stdev = nan
Maximum AbsoluteFlat Difference = nan
Minimum AbsoluteFlat Difference = nan
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 26%
-> 3xtheshold = 1%
-> 5xtheshold = 0%
*** Result of the test: FAILED
Unable to determine mean, meadian, and std_dev for the slice06
Working with slice: 07
Subwindow origin: px0=326 py0=1345
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 07
Absolute Flat Difference : mean = nan median = nan stdev = nan
Maximum AbsoluteFlat Difference = nan
Minimum AbsoluteFlat Difference = nan
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 29%
-> 3xtheshold = 1%
-> 5xtheshold = 0%
*** Result of the test: FAILED
Unable to determine mean, meadian, and std_dev for the slice07
Working with slice: 08
Subwindow origin: px0=258 py0=584
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 08
Absolute Flat Difference : mean = nan median = nan stdev = nan
Maximum AbsoluteFlat Difference = nan
Minimum AbsoluteFlat Difference = nan
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 26%
-> 3xtheshold = 1%
-> 5xtheshold = 0%
*** Result of the test: FAILED
Unable to determine mean, meadian, and std_dev for the slice08
Working with slice: 09
Subwindow origin: px0=331 py0=1394
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 09
Absolute Flat Difference : mean = nan median = nan stdev = nan
Maximum AbsoluteFlat Difference = nan
Minimum AbsoluteFlat Difference = nan
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 29%
-> 3xtheshold = 1%
-> 5xtheshold = 0%
*** Result of the test: FAILED
Unable to determine mean, meadian, and std_dev for the slice09
Working with slice: 10
Subwindow origin: px0=254 py0=534
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 10
Absolute Flat Difference : mean = nan median = nan stdev = nan
Maximum AbsoluteFlat Difference = nan
Minimum AbsoluteFlat Difference = nan
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 25%
-> 3xtheshold = 1%
-> 5xtheshold = 0%
*** Result of the test: FAILED
Unable to determine mean, meadian, and std_dev for the slice10
Working with slice: 11
Subwindow origin: px0=336 py0=1442
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 11
Absolute Flat Difference : mean = nan median = nan stdev = nan
Maximum AbsoluteFlat Difference = nan
Minimum AbsoluteFlat Difference = nan
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 29%
-> 3xtheshold = 1%
-> 5xtheshold = 0%
*** Result of the test: FAILED
Unable to determine mean, meadian, and std_dev for the slice11
Working with slice: 12
Subwindow origin: px0=250 py0=485
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 12
Absolute Flat Difference : mean = nan median = nan stdev = nan
Maximum AbsoluteFlat Difference = nan
Minimum AbsoluteFlat Difference = nan
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 25%
-> 3xtheshold = 1%
-> 5xtheshold = 0%
*** Result of the test: FAILED
Unable to determine mean, meadian, and std_dev for the slice12
Working with slice: 13
Subwindow origin: px0=340 py0=1491
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 13
Absolute Flat Difference : mean = nan median = nan stdev = nan
Maximum AbsoluteFlat Difference = nan
Minimum AbsoluteFlat Difference = nan
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 29%
-> 3xtheshold = 1%
-> 5xtheshold = 0%
*** Result of the test: FAILED
Unable to determine mean, meadian, and std_dev for the slice13
Working with slice: 14
Subwindow origin: px0=246 py0=436
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 14
Absolute Flat Difference : mean = nan median = nan stdev = nan
Maximum AbsoluteFlat Difference = nan
Minimum AbsoluteFlat Difference = nan
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 25%
-> 3xtheshold = 1%
-> 5xtheshold = 0%
*** Result of the test: FAILED
Unable to determine mean, meadian, and std_dev for the slice14
Working with slice: 15
Subwindow origin: px0=345 py0=1540
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 15
Absolute Flat Difference : mean = nan median = nan stdev = nan
Maximum AbsoluteFlat Difference = nan
Minimum AbsoluteFlat Difference = nan
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 29%
-> 3xtheshold = 1%
-> 5xtheshold = 0%
*** Result of the test: FAILED
Unable to determine mean, meadian, and std_dev for the slice15
Working with slice: 16
Subwindow origin: px0=242 py0=386
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 16
Absolute Flat Difference : mean = nan median = nan stdev = nan
Maximum AbsoluteFlat Difference = nan
Minimum AbsoluteFlat Difference = nan
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 25%
-> 3xtheshold = 1%
-> 5xtheshold = 0%
*** Result of the test: FAILED
Unable to determine mean, meadian, and std_dev for the slice16
Working with slice: 17
Subwindow origin: px0=350 py0=1589
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 17
Absolute Flat Difference : mean = nan median = nan stdev = nan
Maximum AbsoluteFlat Difference = nan
Minimum AbsoluteFlat Difference = nan
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 29%
-> 3xtheshold = 1%
-> 5xtheshold = 0%
*** Result of the test: FAILED
Unable to determine mean, meadian, and std_dev for the slice17
Working with slice: 18
Subwindow origin: px0=238 py0=337
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 18
Absolute Flat Difference : mean = nan median = nan stdev = nan
Maximum AbsoluteFlat Difference = nan
Minimum AbsoluteFlat Difference = nan
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 25%
-> 3xtheshold = 1%
-> 5xtheshold = 0%
*** Result of the test: FAILED
Unable to determine mean, meadian, and std_dev for the slice18
Working with slice: 19
Subwindow origin: px0=355 py0=1638
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 19
Absolute Flat Difference : mean = nan median = nan stdev = nan
Maximum AbsoluteFlat Difference = nan
Minimum AbsoluteFlat Difference = nan
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 29%
-> 3xtheshold = 1%
-> 5xtheshold = 0%
*** Result of the test: FAILED
Unable to determine mean, meadian, and std_dev for the slice19
Working with slice: 20
Subwindow origin: px0=235 py0=288
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 20
Absolute Flat Difference : mean = nan median = nan stdev = nan
Maximum AbsoluteFlat Difference = nan
Minimum AbsoluteFlat Difference = nan
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 24%
-> 3xtheshold = 1%
-> 5xtheshold = 0%
*** Result of the test: FAILED
Unable to determine mean, meadian, and std_dev for the slice20
Working with slice: 21
Subwindow origin: px0=360 py0=1687
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 21
Absolute Flat Difference : mean = nan median = nan stdev = nan
Maximum AbsoluteFlat Difference = nan
Minimum AbsoluteFlat Difference = nan
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 30%
-> 3xtheshold = 1%
-> 5xtheshold = 0%
*** Result of the test: FAILED
Unable to determine mean, meadian, and std_dev for the slice21
Working with slice: 22
Subwindow origin: px0=231 py0=238
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 22
Absolute Flat Difference : mean = nan median = nan stdev = nan
Maximum AbsoluteFlat Difference = nan
Minimum AbsoluteFlat Difference = nan
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 24%
-> 3xtheshold = 1%
-> 5xtheshold = 0%
*** Result of the test: FAILED
Unable to determine mean, meadian, and std_dev for the slice22
Working with slice: 23
Subwindow origin: px0=365 py0=1736
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 23
Absolute Flat Difference : mean = nan median = nan stdev = nan
Maximum AbsoluteFlat Difference = nan
Minimum AbsoluteFlat Difference = nan
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 29%
-> 3xtheshold = 1%
-> 5xtheshold = 0%
*** Result of the test: FAILED
Unable to determine mean, meadian, and std_dev for the slice23
Working with slice: 24
Subwindow origin: px0=227 py0=189
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 24
Absolute Flat Difference : mean = nan median = nan stdev = nan
Maximum AbsoluteFlat Difference = nan
Minimum AbsoluteFlat Difference = nan
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 25%
-> 3xtheshold = 1%
-> 5xtheshold = 0%
*** Result of the test: FAILED
Unable to determine mean, meadian, and std_dev for the slice24
Working with slice: 25
Subwindow origin: px0=370 py0=1784
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 25
Absolute Flat Difference : mean = nan median = nan stdev = nan
Maximum AbsoluteFlat Difference = nan
Minimum AbsoluteFlat Difference = nan
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 30%
-> 3xtheshold = 1%
-> 5xtheshold = 0%
*** Result of the test: FAILED
Unable to determine mean, meadian, and std_dev for the slice25
Working with slice: 26
Subwindow origin: px0=223 py0=140
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 26
Absolute Flat Difference : mean = nan median = nan stdev = nan
Maximum AbsoluteFlat Difference = nan
Minimum AbsoluteFlat Difference = nan
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 25%
-> 3xtheshold = 1%
-> 5xtheshold = 0%
*** Result of the test: FAILED
Unable to determine mean, meadian, and std_dev for the slice26
Working with slice: 27
Subwindow origin: px0=375 py0=1833
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 27
Absolute Flat Difference : mean = nan median = nan stdev = nan
Maximum AbsoluteFlat Difference = nan
Minimum AbsoluteFlat Difference = nan
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 30%
-> 3xtheshold = 1%
-> 5xtheshold = 0%
*** Result of the test: FAILED
Unable to determine mean, meadian, and std_dev for the slice27
Working with slice: 28
Subwindow origin: px0=219 py0=90
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 28
Absolute Flat Difference : mean = nan median = nan stdev = nan
Maximum AbsoluteFlat Difference = nan
Minimum AbsoluteFlat Difference = nan
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 20%
-> 3xtheshold = 1%
-> 5xtheshold = 0%
*** Result of the test: FAILED
Unable to determine mean, meadian, and std_dev for the slice28
Working with slice: 29
Subwindow origin: px0=380 py0=1882
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 29
Absolute Flat Difference : mean = nan median = nan stdev = nan
Maximum AbsoluteFlat Difference = nan
Minimum AbsoluteFlat Difference = nan
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 31%
-> 3xtheshold = 1%
-> 5xtheshold = 0%
*** Result of the test: FAILED
Unable to determine mean, meadian, and std_dev for the slice29
*** Final result for flat_field test will be reported as FAILED ***
('* Script flattest_ifu.py script took ', '43.073919808864595 minutes to finish.')
Did flat_field validation test passed? One or more slices FAILED flat_field test.
Testing files for detector: nrs2
Working with uncal_file: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/ifu_g395h_f290lp_nrs2_uncal.fits
2021-04-23 17:58:55,703 - stpipe - INFO - PARS-DETECTOR1PIPELINE parameters found: /grp/crds/cache/references/jwst/jwst_nirspec_pars-detector1pipeline_0004.asdf
2021-04-23 17:58:55,717 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2021-04-23 17:58:55,718 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2021-04-23 17:58:55,719 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2021-04-23 17:58:55,720 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2021-04-23 17:58:55,721 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2021-04-23 17:58:55,722 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2021-04-23 17:58:55,723 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2021-04-23 17:58:55,725 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2021-04-23 17:58:55,726 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2021-04-23 17:58:55,727 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2021-04-23 17:58:55,728 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2021-04-23 17:58:55,729 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2021-04-23 17:58:55,730 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2021-04-23 17:58:55,731 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2021-04-23 17:58:55,732 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2021-04-23 17:58:55,734 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2021-04-23 17:58:55,735 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/stpipe/step.py:359: ResourceWarning: unclosed file <_io.FileIO name='/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/ifu_g395h_f290lp_nrs2_uncal.fits' mode='rb' closefd=True>
gc.collect()
2021-04-23 17:58:56,384 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/ifu_g395h_f290lp_nrs2_uncal.fits',).
2021-04-23 17:58:56,398 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 4.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 200.0, 'min_jump_to_flag_neighbors': 10.0}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2021-04-23 17:58:56,612 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'ifu_g395h_f290lp_nrs2_uncal.fits' reftypes = ['dark', 'gain', 'linearity', 'mask', 'persat', 'readnoise', 'refpix', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2021-04-23 17:58:56,619 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_dark_0085.fits'.
2021-04-23 17:58:56,620 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_gain_0020.fits'.
2021-04-23 17:58:56,621 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_linearity_0025.fits'.
2021-04-23 17:58:56,622 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_mask_0011.fits'.
2021-04-23 17:58:56,623 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2021-04-23 17:58:56,623 - stpipe.Detector1Pipeline - INFO - Prefetch for READNOISE reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0017.fits'.
2021-04-23 17:58:56,625 - stpipe.Detector1Pipeline - INFO - Prefetch for REFPIX reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_refpix_0018.fits'.
2021-04-23 17:58:56,626 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is 'N/A'.
2021-04-23 17:58:56,626 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is 'N/A'.
2021-04-23 17:58:56,626 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_saturation_0026.fits'.
2021-04-23 17:58:56,627 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_superbias_0118.fits'.
2021-04-23 17:58:56,628 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2021-04-23 17:58:56,629 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2021-04-23 17:58:56,629 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2021-04-23 17:58:57,719 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs2_uncal.fits>,).
2021-04-23 17:58:57,721 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 17:58:58,543 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES and FRMDIVSR are equal; correction not needed
2021-04-23 17:58:58,543 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2021-04-23 17:58:58,544 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2021-04-23 17:58:58,818 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs2_uncal.fits>,).
2021-04-23 17:58:58,820 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 17:58:58,836 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_nirspec_mask_0011.fits
2021-04-23 17:58:59,792 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2021-04-23 17:59:00,169 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs2_uncal.fits>,).
2021-04-23 17:59:00,171 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 17:59:00,189 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_nirspec_saturation_0026.fits
2021-04-23 17:59:03,255 - stpipe.Detector1Pipeline.saturation - INFO - Detected 151502 saturated pixels
2021-04-23 17:59:03,424 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2021-04-23 17:59:03,445 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2021-04-23 17:59:03,820 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs2_uncal.fits>,).
2021-04-23 17:59:03,821 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 17:59:03,822 - stpipe.Detector1Pipeline.ipc - INFO - Step skipped.
2021-04-23 17:59:03,823 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2021-04-23 17:59:04,094 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs2_uncal.fits>,).
2021-04-23 17:59:04,095 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 17:59:04,113 - stpipe.Detector1Pipeline.superbias - INFO - Using SUPERBIAS reference file /grp/crds/cache/references/jwst/jwst_nirspec_superbias_0118.fits
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/stdatamodels/validate.py:34: ValidationWarning: While validating meta.exposure.readpatt the following error occurred:
'ALLIRS2' is not one of ['ACQ1', 'ACQ2', 'BRIGHT1', 'BRIGHT2', 'DEEP2', 'DEEP8', 'FAST', 'FASTGRPAVG', 'FASTGRPAVG8', 'FASTGRPAVG16', 'FASTGRPAVG32', 'FASTGRPAVG64', 'FASTR1', 'FASTR100', 'FGS', 'FGS60', 'FGS8370', 'FGS840', 'FGSRAPID', 'FINEGUIDE', 'ID', 'MEDIUM2', 'MEDIUM8', 'NIS', 'NISRAPID', 'NRS', 'NRSIRS2', 'NRSN16R4', 'NRSN32R8', 'NRSN8R2', 'NRSRAPID', 'NRSIRS2RAPID', 'NRSRAPIDD1', 'NRSRAPIDD2', 'NRSRAPIDD6', 'NRSSLOW', 'RAPID', 'SHALLOW2', 'SHALLOW4', 'SLOW', 'SLOWR1', 'TRACK', 'ANY', 'N/A']
Failed validating 'enum' in schema:
OrderedDict([('title', 'Readout pattern'),
('type', 'string'),
('enum',
['ACQ1',
'ACQ2',
'BRIGHT1',
'BRIGHT2',
'DEEP2',
'DEEP8',
'FAST',
'FASTGRPAVG',
'FASTGRPAVG8',
'FASTGRPAVG16',
'FASTGRPAVG32',
'FASTGRPAVG64',
'FASTR1',
'FASTR100',
'FGS',
'FGS60',
'FGS8370',
'FGS840',
'FGSRAPID',
'FINEGUIDE',
'ID',
'MEDIUM2',
'MEDIUM8',
'NIS',
'NISRAPID',
'NRS',
'NRSIRS2',
'NRSN16R4',
'NRSN32R8',
'NRSN8R2',
'NRSRAPID',
'NRSIRS2RAPID',
'NRSRAPIDD1',
'NRSRAPIDD2',
'NRSRAPIDD6',
'NRSSLOW',
'RAPID',
'SHALLOW2',
'SHALLOW4',
'SLOW',
'SLOWR1',
'TRACK',
'ANY',
'N/A']),
('fits_ke ...
warnings.warn(errmsg, ValidationWarning)
2021-04-23 17:59:07,399 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias done
2021-04-23 17:59:07,772 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs2_uncal.fits>,).
2021-04-23 17:59:07,774 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2021-04-23 17:59:07,791 - stpipe.Detector1Pipeline.refpix - INFO - Using refpix reference file: /grp/crds/cache/references/jwst/jwst_nirspec_refpix_0018.fits
2021-04-23 18:00:15,220 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2021-04-23 18:00:15,735 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs2_uncal.fits>,).
2021-04-23 18:00:15,736 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 18:00:15,759 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_nirspec_linearity_0025.fits
2021-04-23 18:00:16,141 - stpipe.Detector1Pipeline.linearity - WARNING - Keyword BAD_LIN_CORR does not correspond to an existing DQ mnemonic, so will be ignored
2021-04-23 18:00:17,548 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2021-04-23 18:00:17,947 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs2_uncal.fits>,).
2021-04-23 18:00:17,948 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4', 'dark_output': None}
2021-04-23 18:00:17,966 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_nirspec_dark_0085.fits
2021-04-23 18:00:58,490 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=1, ngroups=20, nframes=1, groupgap=0
2021-04-23 18:00:58,491 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=1, ngroups=65, nframes=1, groupgap=0
2021-04-23 18:00:59,286 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2021-04-23 18:01:00,141 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs2_uncal.fits>,).
2021-04-23 18:01:00,143 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4', 'rejection_threshold': 4.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 200.0, 'min_jump_to_flag_neighbors': 10.0}
2021-04-23 18:01:00,151 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 4 sigma
2021-04-23 18:01:00,162 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0020.fits
2021-04-23 18:01:00,700 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0017.fits
2021-04-23 18:01:01,743 - stpipe.Detector1Pipeline.jump - INFO - Found 32 possible cores to use for jump detection
2021-04-23 18:01:02,533 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2021-04-23 18:01:03,416 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
2021-04-23 18:01:07,181 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier Two-point found 83533 pixels with at least one CR
2021-04-23 18:01:14,226 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 11.6923 sec
2021-04-23 18:01:14,228 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 14.076603
2021-04-23 18:01:14,229 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2021-04-23 18:01:14,562 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs2_uncal.fits>,).
2021-04-23 18:01:14,563 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}
2021-04-23 18:01:14,589 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0017.fits
2021-04-23 18:01:14,627 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0020.fits
2021-04-23 18:01:14,645 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2021-04-23 18:01:14,646 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/jwst/ramp_fitting/ramp_fit.py:872: RuntimeWarning: invalid value encountered in multiply
var_p4[num_int,:,:,:] *= ( segs_4[num_int,:,:,:] > 0)
2021-04-23 18:03:53,246 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 20
2021-04-23 18:03:53,247 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 1
2021-04-23 18:03:53,369 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2021-04-23 18:03:53,791 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<IFUImageModel(2048, 2048) from ifu_g395h_f290lp_nrs2_uncal.fits>,).
2021-04-23 18:03:53,793 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 18:03:53,853 - stpipe.Detector1Pipeline.gain_scale - INFO - Rescaling by 1.0
2021-04-23 18:03:53,862 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2021-04-23 18:03:54,146 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(1, 2048, 2048) from ifu_g395h_f290lp_nrs2_uncal.fits>,).
2021-04-23 18:03:54,147 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': '/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4'}
2021-04-23 18:03:54,201 - stpipe.Detector1Pipeline.gain_scale - INFO - Rescaling by 1.0
2021-04-23 18:03:54,210 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2021-04-23 18:03:54,211 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2021-04-23 18:03:54,211 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2021-04-23 18:03:54,221 - stpipe.AssignWcsStep - INFO - AssignWcsStep instance created.
2021-04-23 18:03:54,597 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep running with args (<IFUImageModel(2048, 2048) from ifu_g395h_f290lp_nrs2_uncal.fits>,).
2021-04-23 18:03:54,599 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2021-04-23 18:03:54,756 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.1448970586061478 deg
2021-04-23 18:03:54,756 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3232757747173309 deg
2021-04-23 18:03:54,757 - stpipe.AssignWcsStep - INFO - theta_y correction: -3.766823889842878e-13 deg
2021-04-23 18:03:54,758 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2021-04-23 18:03:58,177 - stpipe.AssignWcsStep - INFO - Created a NIRSPEC nrs_ifu pipeline with references {'distortion': None, 'filteroffset': None, 'specwcs': None, 'regions': None, 'wavelengthrange': '/grp/crds/cache/references/jwst/jwst_nirspec_wavelengthrange_0004.asdf', 'camera': '/grp/crds/cache/references/jwst/jwst_nirspec_camera_0004.asdf', 'collimator': '/grp/crds/cache/references/jwst/jwst_nirspec_collimator_0004.asdf', 'disperser': '/grp/crds/cache/references/jwst/jwst_nirspec_disperser_0035.asdf', 'fore': '/grp/crds/cache/references/jwst/jwst_nirspec_fore_0022.asdf', 'fpa': '/grp/crds/cache/references/jwst/jwst_nirspec_fpa_0005.asdf', 'msa': '/grp/crds/cache/references/jwst/jwst_nirspec_msa_0005.asdf', 'ote': '/grp/crds/cache/references/jwst/jwst_nirspec_ote_0005.asdf', 'ifupost': '/grp/crds/cache/references/jwst/jwst_nirspec_ifupost_0004.asdf', 'ifufore': '/grp/crds/cache/references/jwst/jwst_nirspec_ifufore_0003.asdf', 'ifuslicer': '/grp/crds/cache/references/jwst/jwst_nirspec_ifuslicer_0003.asdf'}
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/gwcs/geometry.py:203: RuntimeWarning: invalid value encountered in remainder
lon = np.mod(lon, 360.0 * u.deg if nquant else 360.0)
2021-04-23 18:05:02,326 - stpipe.AssignWcsStep - INFO - Update S_REGION to POLYGON ICRS 156.176996289 -45.687617183 156.178772625 -45.687617183 156.178772625 -45.686330364 156.176996289 -45.686330364
2021-04-23 18:05:02,327 - stpipe.AssignWcsStep - INFO - COMPLETED assign_wcs
2021-04-23 18:05:02,330 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep done
2021-04-23 18:05:02,339 - stpipe.MSAFlagOpenStep - INFO - MSAFlagOpenStep instance created.
2021-04-23 18:05:03,199 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep running with args (<IFUImageModel(2048, 2048) from ifu_g395h_f290lp_nrs2_uncal.fits>,).
2021-04-23 18:05:03,204 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-04-23 18:05:03,225 - stpipe.MSAFlagOpenStep - INFO - Using reference file /grp/crds/cache/references/jwst/jwst_nirspec_msaoper_0001.json
2021-04-23 18:05:03,226 - stpipe.JwstStep - INFO - JwstStep instance created.
2021-04-23 18:05:03,341 - stpipe.MSAFlagOpenStep - INFO - gwa_ytilt is 0.1448970586061478 deg
2021-04-23 18:05:03,342 - stpipe.MSAFlagOpenStep - INFO - gwa_xtilt is 0.3232757747173309 deg
2021-04-23 18:05:03,342 - stpipe.MSAFlagOpenStep - INFO - theta_y correction: -3.766823889842878e-13 deg
2021-04-23 18:05:03,343 - stpipe.MSAFlagOpenStep - INFO - theta_x correction: 0.0 deg
2021-04-23 18:05:03,350 - stpipe.MSAFlagOpenStep - INFO - SPORDER= -1, wrange=[2.87e-06, 5.27e-06]
2021-04-23 18:05:03,447 - stpipe.MSAFlagOpenStep - INFO - There are 5 open slits in quadrant 1
2021-04-23 18:05:03,488 - stpipe.MSAFlagOpenStep - INFO - There are 3 open slits in quadrant 2
2021-04-23 18:05:03,513 - stpipe.MSAFlagOpenStep - INFO - There are 9 open slits in quadrant 3
2021-04-23 18:05:03,587 - stpipe.MSAFlagOpenStep - INFO - There are 3 open slits in quadrant 4
2021-04-23 18:05:03,612 - stpipe.MSAFlagOpenStep - INFO - There are 0 open slits in quadrant 5
2021-04-23 18:05:17,870 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep done
2021-04-23 18:05:17,879 - stpipe.SourceTypeStep - INFO - SourceTypeStep instance created.
2021-04-23 18:05:18,454 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep running with args (<IFUImageModel(2048, 2048) from ifu_g395h_f290lp_nrs2_uncal.fits>,).
2021-04-23 18:05:18,458 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-04-23 18:05:18,465 - stpipe.SourceTypeStep - INFO - Input EXP_TYPE is NRS_IFU
2021-04-23 18:05:18,466 - stpipe.SourceTypeStep - INFO - Input SRCTYAPT = UNKNOWN
2021-04-23 18:05:18,466 - stpipe.SourceTypeStep - INFO - Input source type is unknown; setting default SRCTYPE = EXTENDED
2021-04-23 18:05:18,467 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep done
2021-04-23 18:05:18,475 - stpipe.WavecorrStep - INFO - WavecorrStep instance created.
2021-04-23 18:05:18,748 - stpipe.WavecorrStep - INFO - Step WavecorrStep running with args (<IFUImageModel(2048, 2048) from ifu_g395h_f290lp_nrs2_uncal.fits>,).
2021-04-23 18:05:18,749 - stpipe.WavecorrStep - INFO - Step WavecorrStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2021-04-23 18:05:18,757 - stpipe.WavecorrStep - INFO - Skipping wavecorr correction for EXP_TYPE NRS_IFU
2021-04-23 18:05:18,757 - stpipe.WavecorrStep - INFO - Step WavecorrStep done
2021-04-23 18:05:18,766 - stpipe.FlatFieldStep - INFO - FlatFieldStep instance created.
2021-04-23 18:05:19,034 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep running with args (<IFUImageModel(2048, 2048) from ifu_g395h_f290lp_nrs2_uncal.fits>,).
2021-04-23 18:05:19,035 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': True, 'user_supplied_flat': None, 'inverse': False}
2021-04-23 18:12:45,188 - stpipe.FlatFieldStep - INFO - Saved model in ifu_g395h_f290lp_nrs2_interpolatedflat.fits
2021-04-23 18:12:45,190 - stpipe.FlatFieldStep - INFO - Interpolated flat written to "ifu_g395h_f290lp_nrs2_interpolatedflat.fits".
2021-04-23 18:12:45,191 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep done
Running flat field test for IFU... flat_field_file --> Grating:G395H Filter:F290LP LAMP:REF Getting and reading the D-, S-, and F-flats for this specific IFU configuration... Using D-flat: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_dflat_nrs2_f_01.03.fits Using S-flat: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_IFU_sflat_G395H_OPAQUE_FLAT3_nrs2_f_01.01.fits Using F-flat: /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_IFU_fflat_F290LP_01.01.fits Now looping through the slices, this may take some time... Working with slice: 00
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/gwcs/geometry.py:203: RuntimeWarning: invalid value encountered in remainder lon = np.mod(lon, 360.0 * u.deg if nquant else 360.0) /data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/gwcs/utils.py:72: DeprecationWarning: `np.int` is a deprecated alias for the builtin `int`. To silence this warning, use `int` by itself. Doing this will not modify any behavior and is safe. When replacing `np.int`, you may wish to use e.g. `np.int64` or `np.int32` to specify the precision. If you wish to review your current use, check the release note link for additional information. Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations indx = np.asarray(np.floor(np.asarray(value) + 0.5), dtype=np.int)
Subwindow origin: px0=1 py0=781
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 00
Absolute Flat Difference : mean = 3.387e-02 median = 3.263e-06 stdev = 1.233e-01
Maximum AbsoluteFlat Difference = 5.518e-01
Minimum AbsoluteFlat Difference = -6.043e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 16%
-> 3xtheshold = 7%
-> 5xtheshold = 7%
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 01
Subwindow origin: px0=1 py0=1197
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 01
Absolute Flat Difference : mean = 3.327e-02 median = 3.233e-06 stdev = 1.228e-01
Maximum AbsoluteFlat Difference = 6.006e-01
Minimum AbsoluteFlat Difference = -8.739e-04
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 17%
-> 3xtheshold = 7%
-> 5xtheshold = 7%
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 02
Subwindow origin: px0=1 py0=731
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 02
Absolute Flat Difference : mean = 3.396e-02 median = 3.377e-06 stdev = 1.236e-01
Maximum AbsoluteFlat Difference = 5.776e-01
Minimum AbsoluteFlat Difference = -6.725e-04
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 17%
-> 3xtheshold = 7%
-> 5xtheshold = 7%
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 03
Subwindow origin: px0=1 py0=1247
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 03
Absolute Flat Difference : mean = 3.309e-02 median = 3.549e-06 stdev = 1.223e-01
Maximum AbsoluteFlat Difference = 5.994e-01
Minimum AbsoluteFlat Difference = -8.231e-04
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 17%
-> 3xtheshold = 7%
-> 5xtheshold = 7%
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 04
Subwindow origin: px0=1 py0=682
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 04
Absolute Flat Difference : mean = 3.392e-02 median = 3.349e-06 stdev = 1.234e-01
Maximum AbsoluteFlat Difference = 7.639e-01
Minimum AbsoluteFlat Difference = -7.885e-04
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 17%
-> 3xtheshold = 7%
-> 5xtheshold = 7%
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 05
Subwindow origin: px0=1 py0=1296
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 05
Absolute Flat Difference : mean = 3.308e-02 median = 3.491e-06 stdev = 1.221e-01
Maximum AbsoluteFlat Difference = 5.454e-01
Minimum AbsoluteFlat Difference = -8.851e-04
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 16%
-> 3xtheshold = 7%
-> 5xtheshold = 7%
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 06
Subwindow origin: px0=1 py0=633
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 06
Absolute Flat Difference : mean = 3.373e-02 median = 3.471e-06 stdev = 1.226e-01
Maximum AbsoluteFlat Difference = 5.672e-01
Minimum AbsoluteFlat Difference = -8.686e-04
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 17%
-> 3xtheshold = 7%
-> 5xtheshold = 7%
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 07
Subwindow origin: px0=1 py0=1345
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 07
Absolute Flat Difference : mean = 3.277e-02 median = 3.493e-06 stdev = 1.216e-01
Maximum AbsoluteFlat Difference = 5.556e-01
Minimum AbsoluteFlat Difference = -7.579e-04
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 17%
-> 3xtheshold = 7%
-> 5xtheshold = 7%
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 08
Subwindow origin: px0=1 py0=584
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 08
Absolute Flat Difference : mean = 3.362e-02 median = 3.319e-06 stdev = 1.221e-01
Maximum AbsoluteFlat Difference = 5.590e-01
Minimum AbsoluteFlat Difference = -8.838e-04
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 17%
-> 3xtheshold = 7%
-> 5xtheshold = 7%
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 09
Subwindow origin: px0=1 py0=1394
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 09
Absolute Flat Difference : mean = 3.279e-02 median = 3.564e-06 stdev = 1.216e-01
Maximum AbsoluteFlat Difference = 5.415e-01
Minimum AbsoluteFlat Difference = -8.051e-04
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 17%
-> 3xtheshold = 7%
-> 5xtheshold = 7%
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 10
Subwindow origin: px0=1 py0=534
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 10
Absolute Flat Difference : mean = 3.392e-02 median = 3.263e-06 stdev = 1.227e-01
Maximum AbsoluteFlat Difference = 5.995e-01
Minimum AbsoluteFlat Difference = -9.347e-04
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 17%
-> 3xtheshold = 7%
-> 5xtheshold = 7%
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 11
Subwindow origin: px0=1 py0=1443
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 11
Absolute Flat Difference : mean = 3.283e-02 median = 3.139e-06 stdev = 1.216e-01
Maximum AbsoluteFlat Difference = 6.244e-01
Minimum AbsoluteFlat Difference = -9.221e-04
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 17%
-> 3xtheshold = 7%
-> 5xtheshold = 7%
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 12
Subwindow origin: px0=1 py0=485
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 12
Absolute Flat Difference : mean = 3.422e-02 median = 3.260e-06 stdev = 1.237e-01
Maximum AbsoluteFlat Difference = 5.866e-01
Minimum AbsoluteFlat Difference = -1.459e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 16%
-> 3xtheshold = 7%
-> 5xtheshold = 7%
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 13
Subwindow origin: px0=1 py0=1491
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 13
Absolute Flat Difference : mean = 3.257e-02 median = 3.352e-06 stdev = 1.210e-01
Maximum AbsoluteFlat Difference = 5.460e-01
Minimum AbsoluteFlat Difference = -8.229e-04
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 17%
-> 3xtheshold = 7%
-> 5xtheshold = 7%
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 14
Subwindow origin: px0=1 py0=436
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 14
Absolute Flat Difference : mean = 3.427e-02 median = 3.463e-06 stdev = 1.240e-01
Maximum AbsoluteFlat Difference = 5.697e-01
Minimum AbsoluteFlat Difference = -8.729e-04
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 16%
-> 3xtheshold = 7%
-> 5xtheshold = 7%
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 15
Subwindow origin: px0=1 py0=1540
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 15
Absolute Flat Difference : mean = 3.243e-02 median = 3.312e-06 stdev = 1.208e-01
Maximum AbsoluteFlat Difference = 5.472e-01
Minimum AbsoluteFlat Difference = -8.280e-04
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 16%
-> 3xtheshold = 7%
-> 5xtheshold = 7%
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 16
Subwindow origin: px0=1 py0=387
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 16
Absolute Flat Difference : mean = 3.436e-02 median = 3.497e-06 stdev = 1.240e-01
Maximum AbsoluteFlat Difference = 5.692e-01
Minimum AbsoluteFlat Difference = -9.005e-04
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 16%
-> 3xtheshold = 8%
-> 5xtheshold = 7%
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 17
Subwindow origin: px0=1 py0=1589
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 17
Absolute Flat Difference : mean = 3.224e-02 median = 3.452e-06 stdev = 1.204e-01
Maximum AbsoluteFlat Difference = 5.919e-01
Minimum AbsoluteFlat Difference = -7.677e-04
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 17%
-> 3xtheshold = 7%
-> 5xtheshold = 7%
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 18
Subwindow origin: px0=1 py0=337
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 18
Absolute Flat Difference : mean = 3.430e-02 median = 3.267e-06 stdev = 1.239e-01
Maximum AbsoluteFlat Difference = 5.769e-01
Minimum AbsoluteFlat Difference = -9.155e-04
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 16%
-> 3xtheshold = 7%
-> 5xtheshold = 7%
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 19
Subwindow origin: px0=1 py0=1638
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 19
Absolute Flat Difference : mean = 3.230e-02 median = 3.502e-06 stdev = 1.205e-01
Maximum AbsoluteFlat Difference = 6.734e-01
Minimum AbsoluteFlat Difference = -9.334e-04
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 17%
-> 3xtheshold = 7%
-> 5xtheshold = 7%
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 20
Subwindow origin: px0=1 py0=288
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 20
Absolute Flat Difference : mean = 3.461e-02 median = 3.525e-06 stdev = 1.247e-01
Maximum AbsoluteFlat Difference = 5.924e-01
Minimum AbsoluteFlat Difference = -8.683e-04
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 16%
-> 3xtheshold = 7%
-> 5xtheshold = 7%
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 21
Subwindow origin: px0=1 py0=1687
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 21
Absolute Flat Difference : mean = 3.213e-02 median = 3.344e-06 stdev = 1.201e-01
Maximum AbsoluteFlat Difference = 5.872e-01
Minimum AbsoluteFlat Difference = -8.637e-04
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 17%
-> 3xtheshold = 7%
-> 5xtheshold = 7%
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 22
Subwindow origin: px0=1 py0=239
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 22
Absolute Flat Difference : mean = 3.501e-02 median = 3.550e-06 stdev = 1.260e-01
Maximum AbsoluteFlat Difference = 7.828e-01
Minimum AbsoluteFlat Difference = -9.306e-04
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 17%
-> 3xtheshold = 8%
-> 5xtheshold = 7%
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 23
Subwindow origin: px0=1 py0=1736
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 23
Absolute Flat Difference : mean = 3.203e-02 median = 3.570e-06 stdev = 1.198e-01
Maximum AbsoluteFlat Difference = 5.444e-01
Minimum AbsoluteFlat Difference = -8.463e-04
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 17%
-> 3xtheshold = 7%
-> 5xtheshold = 7%
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 24
Subwindow origin: px0=1 py0=189
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 24
Absolute Flat Difference : mean = 3.503e-02 median = 3.476e-06 stdev = 1.261e-01
Maximum AbsoluteFlat Difference = 6.049e-01
Minimum AbsoluteFlat Difference = -8.911e-04
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 17%
-> 3xtheshold = 8%
-> 5xtheshold = 7%
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 25
Subwindow origin: px0=1 py0=1784
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 25
Absolute Flat Difference : mean = 3.184e-02 median = 3.434e-06 stdev = 1.194e-01
Maximum AbsoluteFlat Difference = 5.577e-01
Minimum AbsoluteFlat Difference = -8.996e-04
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 17%
-> 3xtheshold = 7%
-> 5xtheshold = 7%
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 26
Subwindow origin: px0=1 py0=140
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 26
Absolute Flat Difference : mean = 3.556e-02 median = 3.446e-06 stdev = 1.273e-01
Maximum AbsoluteFlat Difference = 5.837e-01
Minimum AbsoluteFlat Difference = -8.995e-04
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 17%
-> 3xtheshold = 8%
-> 5xtheshold = 7%
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 27
Subwindow origin: px0=1 py0=1833
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 27
Absolute Flat Difference : mean = 3.179e-02 median = 3.565e-06 stdev = 1.194e-01
Maximum AbsoluteFlat Difference = 8.581e-01
Minimum AbsoluteFlat Difference = -1.566e-03
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 17%
-> 3xtheshold = 7%
-> 5xtheshold = 7%
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 28
Subwindow origin: px0=1 py0=90
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 28
Absolute Flat Difference : mean = 3.509e-02 median = 2.911e-06 stdev = 1.260e-01
Maximum AbsoluteFlat Difference = 5.756e-01
Minimum AbsoluteFlat Difference = -7.690e-04
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 14%
-> 3xtheshold = 7%
-> 5xtheshold = 7%
Making the plot for this slice...
*** Result of the test: PASSED
Working with slice: 29
Subwindow origin: px0=1 py0=1882
Looping through the wavelength, this may take a little time ...
Flat value differences for slice number: 29
Absolute Flat Difference : mean = nan median = nan stdev = nan
Maximum AbsoluteFlat Difference = nan
Minimum AbsoluteFlat Difference = nan
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 17%
-> 3xtheshold = 7%
-> 5xtheshold = 7%
*** Result of the test: FAILED
Unable to determine mean, meadian, and std_dev for the slice29
*** Final result for flat_field test will be reported as FAILED ***
('* Script flattest_ifu.py script took ', '43.18582430283229 minutes to finish.')
Did flat_field validation test passed? One or more slices FAILED flat_field test.
Closing file: popenfile(path='/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/ifu_g395h_f290lp_nrs2_interpolatedflat.fits', fd=46, position=16804800, mode='r', flags=557056)
Closing file: popenfile(path='/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_dflat_nrs2_f_01.03.fits', fd=47, position=680480640, mode='r', flags=557056)
Closing file: popenfile(path='/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_IFU_sflat_G395H_OPAQUE_FLAT3_nrs2_f_01.01.fits', fd=48, position=50500800, mode='r', flags=557056)
Closing file: popenfile(path='/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpi4uk6ez4/nirspec_IFU_fflat_F290LP_01.01.fits', fd=49, position=86400, mode='r', flags=557056)
# Quickly see if the test passed
print('These are the final results of the tests: ')
for key, val in results_dict.items():
print(key, val)
These are the final results of the tests: fs_prism_nrs1_uncal.fits All slits PASSED flat_field test. fs_prism_nrs2_uncal.fits All slits PASSED flat_field test. fs_fullframe_g395h_f290lp_nrs1_uncal.fits All slits PASSED flat_field test. fs_fullframe_g395h_f290lp_nrs2_uncal.fits All slits PASSED flat_field test. mos_prism_nrs1_uncal.fits All slitlets PASSED flat_field test. mos_prism_nrs2_uncal.fits skipped mos_g140m_line1_NRS1_uncal.fits All slitlets PASSED flat_field test. mos_g140m_line1_NRS2_uncal.fits All slitlets PASSED flat_field test. ifu_prism_nrs1_uncal.fits All slices PASSED flat_field test. ifu_prism_nrs2_uncal.fits skipped ifu_g395h_f290lp_nrs1_uncal.fits One or more slices FAILED flat_field test. ifu_g395h_f290lp_nrs2_uncal.fits One or more slices FAILED flat_field test.
/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.8/site-packages/ipykernel/ipkernel.py:283: DeprecationWarning: `should_run_async` will not call `transform_cell` automatically in the future. Please pass the result to `transformed_cell` argument and any exception that happen during thetransform in `preprocessing_exc_tuple` in IPython 7.17 and above. and should_run_async(code)
Author: Maria A. Pena-Guerrero, Staff Scientist II - Systems Science Support, NIRSpec
Updated On: April/7/2021